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PREFACE 



The dacuroentaLion of large-scale development endeavors in 
education is a pb^nomenon with which the educational R&D coitaunity 
has had modest experience, since tl\ere has been little large-scale 
development to document. SVjjlL do'cumentatiort experience confirms 
the applicability of perek Price's cbnclusipn regarding^ tKe litera- 
cure of research and the. literature clf development. ^ * 



A scholarly publication n\ot a .piece of information 
but an expression of the state of a scholar or a 
group of- scholars of a parftdular time. We do not, 
contrary to superstition, putllish a fact, ^a theory, 
6r a finding, , btit some compleW of these .... If 
the paper is an expressioh of\a person or several 
persons working at the reseafih front^w^can tell 
sometKing about'^'the relations Umone^^-^:^^ from 
the papers themselves- . . . , L^P^^ems that ^ 
technologists differ markelj::^^om both scientific 
and nonscientif ic schgi^^sT They have' a quite 
different scheme Q^n^^^cl^l i/elitions5hi^)S , are dif- 
ferently mo|jiva;P^dT ancf'fisplay different personality 
traits [Priceip^970, pp.' 7-9] .L 



Clearly, the p^bli^hed'^aper i^s 
end product of', a worker iiA a te 
appears to be instead concerned 
production of dn artifact* or.prOcess. 
the role of literature in technology? 



not, in general, the 
hnological subject; he 
-chiefly ;&ith the; 

What theia^^ is 
I suggest, 



that fx)r the most part it is produced as an epipheno- 
menon.* It comes "about because many, technologists 
have Kad scientific training and^ know full well the 
code of behavior of the scientist in which publication 
is not merely right and proper, but a high duty and a 
behavior expected by peers and employers . . . . . In 
general new technology will flow from old technology rather 
^ than from any interaction there might be between the 

analogous " lHyt ^^parate Btructutes of scienc^e and technolpgy 
[Price, J.965, pp. 560-561^. 
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SWRL experience ha^ t|een that the course of a well-managed develop- 
ment effort produces considerable documentation but that a good deal of 

the substance of thq infpnuation exceeds structures and strictui^es of 

ft 

journal publication. The journal article constitutes an available 
medium, but the laundering of the information required to use the medium 
often washes out the message. 

SWRL has found it unproductive to treat information and documentation 

in the abstract as a ^'cdnsuiaLeation problem.*' A more useful approach is 
ft 

to consider operational means of making information pertinent to large- 
scale development in education conveniently "^available to interested 
audiences. This perspective directs attention to specifying interested 
audiences and devising communication compatible with their need-to-know 
characteristics. SWRL infor\nation architecture recognizes ^several 
audiences. ^ / ' 

V 

Staff Involved in the deviplopment per se and the cor/t;ract sponsor 

are two of- the most. Immediate audiences addressed by SWrI documentation. 

'1 \ 

Communication relevant to these audiences 1^ handled by SWRL Techhical 

-\ 

Notes and Technical Memoranda that chronicle the coursej of SWRL R&D. 

] 

These documents range in length from a few to a few htjr](dred pages de- 
pending upon their nature. Some 200 of these Technical Notes and' 
technical Memoranda are issued during the course of a j^ear — a stack 
several feet tall, \ 

4 i 



A third audience is the invisible colleges in which SWRL staff 
a.aively participate. CoIIegial ' exchange of selected. Technical Notes 
and Technical Memoranda serve this audience adequately.^ 

Another audience is product users. A volume of product working 
papers that brings together the documents associated with the development 
ot each product is issued at the time the product is made available 
tor general use and provides relevant information^ for this audience. 

This leaves the general audience of , student's , scholars, and other 
members of the R^D community in education. SWRL Technical Reports and 
Professional Papers, largely accessed via the ERIC system, are directed 
Lo this broad audience. Journals, professional meet ings , .and other 
classical scientific and technical information Exchange irnechanisms are 
also used. „ 

But each of these mechanisms involves a packing and rationalizing 
of information into independent pieces that inherently involves time 
delays and loses some of the original flavor of the work in the process. 
To reduce the time interval and retain the fre.shness of the work, an 
Annual Work'ipg Paper^s series has been initiated. The t;hematic topics 
that provide] convenience categories for representing inquiry completed 
during 'the past year that is of timely interest to a sector of the 
'educational R&D community will be identified. The documents relevant 
to Lhete topics will th\^o be organized i'ntd the volumes constituting . 
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the Annual Working Papers /or that year. ^."Computer-Based Systems to 
Facilitate In struct ibna 1 Development" is one of four such volumes for 
the year 1972. The other three volumes of the: 1972 SWRL Working Papers 
available through the ERIC system, include the followirvg titles: 

Design of an Instructional Management System 
(John'F. McManus, editor) 

T^vI"n.tegration of Content, Task, and Skills Analysis Techniques 
..^'Instructional Design (David W. Bessemer and Edward L. 
^Smith, editors) 

Prototype Testing in Instructional Development 
(Fred C. Niedermeyer, editor) * 
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COMP/UTER-BASED SYSTEMS TO- FACILITATE INSTRUCTIONAL 
DEVELOPMENT ^ 

\ ^ * 

Joseph F. Follettie and Frank Teplitzky 

The use of computer-based systems as functional tools to facilitate 
R6cD has received a good deal of attention in fields other than educa^Aon. 
The effort directed to this end has had highly beneficial effects on the 
R6tD in these fields. In education, the interest in the computer as- an in- 
structional device has so occupied attention that potentials for computer- 
based systems as utility/tools in educational R&D per se has all but 
escaped notice . 

Acquiring ancf using state-of-the-art systems developed to date in 

other fields is a routine necessity for a large-scale R&D organization 

in education. After doing this, SWRL has encQuntered still' additional 

w 

unique requirements .to support the systematic development of insfetuction. 
These requirements are not satisfied by current shelf ifems. This 

document pertains to two such requirements tg which SWRL effort has 

• ' - % . 

been directed.' ^ 

"* » * ♦» 

The volume reproduces a sample of -SWRl. Technical Notes^ and Technical^ ^ 

Memoranda produced in 1972. dealing wi'tfh natural language analysis and 
student-instruction interaction facets of the organization's computer- 
based research ef^rt. The natural language angljfsi^ activity centers 
on development of a Language Analysis Package (L.A.P.). Analogous to 
the UCLA Bi-Med statistical analysis programs, the interactive -modu- 
larized L. A. Ps ' permits a user to analyze natural language samples m 
various ways while using any of "a variety of remote computers. , The 

V . 



student -instruction interattion activity centers on design, development 
and extension of an Instructional-Development (ControJ and Monitoring 
System (IDCMS),— >a multiple -station instructional research system whose 
controller is a small 'computer . ' 
\ Part I contains three pipers describing aspects , of the Language 
Analysis Package. Part II contains .four- papers dealing with the In- 
structional Deyelopment • Control and Monitoring System. Part III pre- 
sents Abstracts of SWRL Technical Notes and Technical Metnoranda piTo- 
duced in 197,1 an< 1972 bearing on natural language analysis, student- 
instruction Interaction, and related , matters . 



r 



■ s 



Working Paper 1 

I^UAGE ANALYSIS PACKAGE (L.A.P.) VERSION I SYSTEM fcsiGN (TM 5-72-06) - 
Ann Porch - . • 

INTROOrCTORY CONCKPl'S * * 

For vi^ars thero have boi^n "packaged programs" in s tatis tical areas . 
;"'.ls,> programs offer guni* r>i 1 . d computational capabilities in a form 
.iii'i tonriat ospocially suited to easy use by researchers whose basic 
iU-iiMUaiion is not that of CompuLer Science.^ Researchers in the social 
sei.m. s, tor instance, are able to perform comp 1 ex mul ti-var iate regres- 

ion analysis by compuLer wi thout' undergoing any special Lraining in 
proi^r.iinming or computer operations. 

\ l^inguage Analysis iackage (L.A.P.) with a power comparable to 
tiiat ot statistical packa).u s will liave considerable general utility. 

It will permit researcliers to use the speed and versat 1 1 i ty of the i 
or pute^ to process uatur i l\hin^uage text as well as numerical data, 
ver example, .researchers doi'nc; studies of textbooks typically analyze 
c;.<'ir data by h^ind. Wlicrv computer technology is employed, a special- 
purpo;,. i>rograni general K wriLtun by the resident programmpr, who-may' 
r:ot 1 Mve specialized training in techniques of natural language process- 
itu-. Hu- results a\e costly, both in time and money spent on processing 
wiLli inofficienL or one-shot programs. Because such programs are limited' 
in scope and written lor a special purpose, the researcher^nds that a 
relatively minor change in his research perspective makes the computer ^ 
program unusable. ^ ^ 



LSff^ i)ixon W. K (ed.). Biomedical Compu t ei^ Pj;ograniiS , Univjof Calif. 
.^Press, ( 1970) and Nie, N\ et al . (ed.), Statistical P ackage! for the 
Social Sciences , McCraw [{ill, ^1970). . ^ 

iO 



During the past ten years, a great deal of work has been done in 
natural language'^rocessing throughout the world in fields suclt as 
•artificial intelligence, information retrieval,- machine translation, 

computational linguistics, and computer sfeylistics. Hundred's^ of computer 

^ ' , • ■ 

programs have been written, debugged, run, and then shelved when the 

. / ^ ■ ■ ■ . 

^researcher went on to another project.' A number of these programs are 

t 

the»product of months of careful work by experts. '-^ " 

1.1.0 Rationalg for. Package Development . , 

The design proposed here suggests the use of the best of those 
existing programs whose authors are willing to release them, together 
with programs written specially for the package. Such an approach has 
..several^ advantages : the package will reflect the power of the^ finest 
specialized programming skill presently available; the development costs 
wil^l be minimized, since one major programming task will consist of 
inter^k^ing the existing programs or subsections in a modular fashion 
under .the direction of <a6)ne control routinej rather than developing each ^ 
of the specialised routines from scratch. By carefully constructing | 
the package*in. a highly independent, modular manner, individual routines 
may be easily 'Hin-plugged'^ and replaced when a more efficient or power- 
ful routine is developed or should a new approach indicate combinations(^/^ 
of functions. Thus, t^e system will be dynamic and open-ended, capabTe 
of. being' easily updated to keep pace witlf the state-of-the-art. 

The package will be developed in several stages. This document 
primarily describes the limited capability of Version I, but x^ill. often 
refer to more powerful capabilities to be incorporated in late,r versions. 
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Care will be taken'to "tag" these-future features and to differentiate. - 
them from the system design for Version T. ^ 

All development will try to keep the entire package as machine 

independent as possible. Certa'inly it will be implemented on a computer 
which can compile and run most of the major computer languages currently 

in use for language prpcessing. ' One such ins tal I'&t ion exists at UCLA, 
where the IBM 360 mod 91 has compilers for the following .languages : • 

PI. /I, FORTRAN I" (G & COBOL, SNOBOL, LISP.'APL, 360 ASSEMBLER, and 

I 

ALGOL. Its operating system also allows for interfacing subroutines 
written in different source languages. 

Certain Ijardware and system software requirements will be essential 
to the efficient development of the L.A.P. Among these are an efficient 
svstem sort-merge routine, multiple tape drives, relatively large" 
amounts of direct-access storage and considerable available core, Agai^n, 
the UCLA installation is one example of a computer center which is amply 
equipped in all areas. ^ 

Subsequent versions of tlie Language Analysis Package will have fie 
ability to perfprm efficiently in all basic areas of natural langua^ 
analysis, and tlie flexibility to operate either on-line or in ha^h mode. 
In a^Sit ion,, beginning with Version I, the L.A.P. will be easily modiy 
fiable at any time, either for more effective general use or for a 
particular research application. a 

Flexibility of use will be a major consj^ration in the development 
of such a pJl^age. Version I of the L.A.P.,' will" provide the u^e^w'ith' 
many options, allowing him to select precisely and easily only the 
functions he requires. No section of the package will be \ 
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•'called-in" unless the researcher specifically requests it. Ho will not * 
be limited to simply an exc lusive •'OR" type selection, where'' he can only 
chose to do either a KWIC or an Index, but will be able to dombine 
routines and Subroutines la the .logical ^order he desires. He may, 
for example, want to produce KUTIC's on words occurring within his 
inclusion list while simultaneously producing an index of all words 
except those in his exclusion list and a frequency count of every nvord • 
in the teOct. He will be able to use only the retrieval aspect of the 
L.A.P, or only the statistical portion without being penalized by the 
fact he is using a package rather than a single program designed 
specifically for his purfiose! ^ 

1-2.0. Types of Processing for Natural La^^uage ' 

A survey of the work currently being done in the field of language 
anaiy^s^ reveals seven ""major areas of present interest and usage which 
can logically included in Version I of the L.A.P. Of the seventy-. five 
projects listed in the November, 1971 Issue of Computers and the Humanities , 
nine dealt with frequency counts, seventeen with KWIC produc tion, fourtedti 
with semantic or content analysis (including automatic abstracting), 
eight with statistics, thirteen with index production, six with retrieval 
systems, six 'wit-h sentence parsing and six with miscellaneous items such 
as machine translation.* Several projects must be considered to fall into 



more'' than one category. Ratios i^ Linguistics in Documentation (Current 



2 

See Porch, Ann, ''People and Projects in Natural Language Processing: 
A Preliminairy Bibliographic Directory'' TM 5-71-10, August \5, 1971, 
107 pages/ ' 



13 • 




Ahsj:racts> , Language and Automation , and Computer Studies in the Hu manities 
and Verbal Behavior are-mu^h the same, although with a slightly heavier 
emphasis on retrieval afid parsing. ' ^ 

1.3.0 Data Bases and i:lAeir Manipulation , 

Since a number ot researchers will be using the L.A.P., Version T 
oi (.he svstemwill have the ability to differentiate amongv data bases, 
seloctiim tiie researciier ' s b.ise or sub-base from a library ofreSident 
<Lira ^ases stored on magnetic tape or disc and making it available for 
his processing. In later versions, the entire library may include the 
[:RlC"files, or state adppted textbooks. Researchers using the L.A.P, 
will He able to obtain an input file conttining only first grade reading 
books ox onlv ERIC documents dealing with readipg. 

Often, data bases that a particular researcher may wish to use have 
l^un prepared elsewhere with each having different input conventions 
and Cormats..^ For example, one data base might have been prepared ^ith 
a logical record length of 100 and in EBCDIC code, ut i 1 izing both upper 
and lower case fcharacters,- wh.ile another might have been prepared with, a 
logical record length of 72, in ASCI I -rode ; and be in upper case only 
with capitals indicated by a preceding the capitalized letter, 

'Version [ of the L.A.P, will be able to handle input formats ^nd sets 
'Of conventi,5^ns that^the researcher can specify (See 3.5.0 Translate Module) 
A researcher may want to use output from one step in the modular L.A.P 
execution as input to another. He may want to select subsets of a given 
data base, process each separately, then ctoss reference the results or 
subsets of the results. He may want to do transformations on the data 

14 
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as it is being proctfssed, and use dhe^ t r^^Ts forme (i data as input. 

•I ^ 

Version 1 of the L. A. P . ;wi 1 1 . be able to save output for further processing 
and will be able to Sc^e subsets of data once thev are selected, in order 
to save the expense of repeated ^retriev^l processing. The researcher 
'will be able to present the system with a new file, or retrieve and use 
a- file e^.rher he or another re.sfearcher has previously used or created 
(see 3/4.0 Input-Output Module). 

l.4.0» Modes of Operation 

In addition to the flexibility of modul^arity, input formats, and 
file handling. Version .1^ of the L.A.P. will take advantage of the best 
features of two basic* kinds of operation. 

An interactive, "conversational" processing environment prtxvides the 
usej^ higfi^f lexibili ty with little training. He interacts with the computer 
by answer ing cjues t ions , providing the program with information about 
Options, he intends to implement for a particular run. On the other 
i^and, a non-interactive, "batch" processing environment is s igni f ican\ly > 
less expensive, because it can take advantage of "slack time" on the . 
computer, and doesn't require costly telephone connect time. For example, . 
.one Los Angele^ service bureau priced interactive time at $360 per CPU 



hour ,• while,. batch\ proc^sing was $150 per 'CPU hoqr. Language analysis 

\ - 

processing requires considerable CPU time, since mo^t computers are not 
designed fpr ^^^^^c^t . scanningNand string manipulat ion\ but rather for numeric 
processing. Version I of the\.A.P, will provide interaction to collect 
the parametric information required for the run from the user, and batcTi" 



3 ^ ' 
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procossiMR for the remai.nlor of the run oa .tho dat-a base. It will do 
so hv having an i n t e r ac t i ve modul e wh i ch sets up the parameters for t-he 
hatch run < see 3.1.0 1 nterac t* Modul e. and 3 . 2 . 0 Con t ro] Modu 1 e V 



BefiVe proceeding into a detai.led description ol the Sv;stem Desif-n 
tor .ersion I, several major terms must he delined. ^ ' ^ 

^^ructurallv, thr I. A. P. will be made up ol Modules, each ol whirl: 

^ ,1 - 

will consist of a Fr og ram . Su J^-Program or Hoirtj_ne. 

\ Program will po r f onn mu 1 1 i - task operations. It will be made .|.p 
ot a number ot Sub-Pro^rL.s which in turn mav contain several RouMnJls 
eaci . Programs will produce complete, tlnished output to the user. 
An example of a, Program is the Retrieve Module. 

A .Suh-Pragram will perform s i^gl e- t ask operat i ong of a complex 
nature. 1 t wi 1 1 i.- n.ade up ot several Ron M ues , '^ach proces.suu, a- & 
■portion of" the Sub- Program ' s ta.sk'. Output from a Sub-Program m^'J*.- 
complete and .o to the u.ser, or ,^aJ serve as input to "another .Sub-p'rogram 
wiMu'n a Program. An example .if a .Sub-Program is the Morphological 
Anal vs is ModiiU* 

A Routine will per 1 on. i ngl e- t ask operations of a,simplp nature. ^ 
It will usual l-v be a depended,/ part of a Sub-Progran, or a Program, al- 
'though occasionally it mav stand alone. (aS in the case of Interra.ce, 
Modules Which are single Routines^. Output from a Routine will be used 
as input data or parameters for other Houtines or Sub-Programs. U 
. will provide no output to the user dire^tlv. - An example of a Routine' 
is the Translate Module. _^ 

16 
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There will be two basic types of Modules used in ^'ersion^'I of the 
L/A.P, .. Function Modules and Interface Modules. 

, _ _ — , — . _ 

A Func t ion Module will be either a Program , Sub-Program , or' ^^t i ne 

which performs an often complex operation. Since each Function Mocf^^le 
* - » * " 

will be '^ln-pluggable" , it is important tp think of the Module in terms 
af the function Itself rather than the way in which it, is accomplished. 
Otherwise/ it will be difficult to establish a sufficiently generalized 
Interface Module allowing any other Program, Sub-Program or Routine to 
be plugged in, as long as it performs the same function. 

An Interface Module will be a Rout ine linking the Control Module 
with a particular Functiogn Module. While the Function Module is designed 
to be readilv "un-pl uggable" , the Interface Module is designed to be a 
more perm^anent part of the package skeleton. It will ^ot be un-plugged 
and replaced each time its- associ ated Function Module is. replaced, but 
only if the conceptualization of the function itself changes. 

"1.6.0 Documentat ion Concepts 

Documentation of the L. A. P.. will be, like the package itself, 
modular. If a function module of the package is changed, because a 
better program has been obtained for that fur^ction, the documentation, 
can be un-plugged along with the softwarje and as easily replaced. 
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.There will be a series of documents reflect ibig the growth of the 
package as a whole', and of each of its component larts. There will be 
three basic types of documentation associated witA various stages of 
developmental progress. Thev ar^: Design Documentat ion User Documen- 
tat ion, and Product Documentation. 

, Desigi^ Documenation will c/6nsist of the L.A.P. System Design Docu- 
metit tor each version of the pAckage, together with the Module Design 
Document for each mo^lule asso(/iat ed. wi th that version. Design documen- 

tation will be produced before the actual imp 1 erne nt^ti^pn of the package 

. ^ t ' ' ' ■ ' 

or anv specific module. Jhej Svstem Resign Document wiia contain a 

systematic conceptual o^erv^ew of the capabilities of a particular' . 

version of the L. A. P . t og(^ ther ^i th "^gene ral ized descr ip-trlons of t> 

modules to be incorporated in tha't version. There will be \a new Sys.tem 

Design Document for each /succes/ive update of * the package as\^a whole. 

The intended audience for the SV'Stem Design Document will be G|ie general 

researcher who can find wav^s fof making use of the pactiage*. The\Module 

Design Documen't, on the other hand, will be of a more technical rtiature 

au'i will he aimed primarily' at the programming staff whose responsibility 

it is to implement the design in a workable form. 

■ ITser ' Documentatlon will consist of t^hree basic types of documents^ 

Module Development Announcements, User's Manual Materials^ and Training 

Materials. Such documen tat ion wi 1 1 he produced after a particular module 

is in operating condition and available to researchers for their use. As 

each function module is brought into working order., a Module Development 

Announcement will be released, indicating the functional capabilities of 
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the module, how it might be used in educational research, what kind of 
Input it requires, and what kind of output it produces. At the same ^ 
time, abuser's Manual^and Training Materials will be issued which will 
give a researcher the detailed information he needs to actually prepare 
data and submit a request for processing by the module. 

'• produc t Documenta t ion will consist qf detailed .technical documen- 
tation, including flowcharts $tid actual program code, for each of the 
modules. Such documentation will be released '/ after all other documen- 
tation relating to the module, and will be intended for a te<:hnical 
aud ience only , a ■ . 

All, three basic types of documentation will follow the \ame general 

I 

format and be tagged with an appropriate nujneric identifier which relates 
back to the briginal System Design Documen^' for the version of which ^ 
is a part (see Documentat ion^Out 1 ine , ' p . i), Be]*ow is an ouTline whiclv^ 
indicates ^:he general form of one such pielle of documentation. It is ' 
an outline of a Module Design Document associated with Version I. 
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TITLE: DESIGN DOCUMENT: SCAN MODULE - L. A. P . /'ERSION^^ 



ABSTRACT ^ , 
This is one of a series of technical design specif ications^for 
.individual modules in the Language Analysis Package (L.A.P.). ^ 



1. Program Objective 

2. Constraints and Limitations 

3. Options and Def'^ults 

4. Data File Specifications 

Input' . • 

Output 

5. Significant Algorithms 

6. Significant Variables (Arrays, etc.) 

7. Etror andvOther Messages ^ 
•8. Called bji?^ and/or . Calls 
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2.0.0 Overview OF L. A. P. design 
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t.1.0 Package Software Functions (see Figure 1) . - 

The Language Analysis Package will provide four basic functions.; - 

Thev will be: System Functions, Data Management Functions, Special 

Parameter Funct ions , and Data Processing Functions. ^ , 

The System Functions will be concerned with the internal functioning 
» - 

of the package itself and the interface of the- package with the ^us€fr 

- ,/-'. • 

(see 3.0.0) . . ' « ' s'";-' 

The Dad-a Management Functions will be concerned with assisting the 
user in the preparation of his input data, data^^se contrbt.^|- and^ 



arranging his output in a form that V^ill best gfej^ilitate ht^ research 

(see 4.0.0) . J j 

The Special Parameter Functions will b© p|'imarily qg^cerned with the 

t' - " '"'^^^ 

definition of limitations on portions of t^^e j^ata to be-irocessed , or 
unusual applications of package processing .pt<^dules (see 5.0.0). 

The Data Processing Functiofis will b^^oncerned with the actual 
analysis of the input data, and the praxltj^tion of information that will 
further the user's research effort (see;fe,Q.O). 
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3" 0.0' OVETRVIEW oi\^^^ SYSTEM FUNCTIONS (see Figure 2) 

System Fun^ctiAns will be those functions performed by the package 
^which are primarily\concerned with the internal functioning of the 

package itself and the interface of the package with the user. Unlike 
' the Data Processing Functions, the System Functions will be written 

• . .; \ . • i ' , ? 

specially for tk\e L. A. P. . rather than obtained from programmers in the ■ 
field of lai^vage processings They will be tailored to the user 
Community- served by' the package and be developed in a manner allowing 
easy modification to conform to the specific needs of new user require- 

ments. " " ^ ^ 

In 'addition, a high level -of _ flexibi 1 i ty will be built into each 
of the System Functions \o that a systems analyst may constan|ly and 
easily update the manner in which communication with the user takes 
place.' In this way, the System Functions wilTr be highly responsive 
to the mo^s of 'interaction most comfortable to the user community the 



pack^r^ is serving at any given time. 

For Version I, five modules will perform ^System Functions. They 
are: Interact Module, Control Module, Log Module, Input-Output Module, 
and Translate Module. • . , ^ 

The Interact Module ' will help the user -to set the parameters for 
his particul^ use of, the package, and to set up the required Transaction 
Language Control necessary to obtain the output he needs. 
/ The Control Module ., will function internally to take the Transaction 
LaViguage Control and establish a decision table for use by the package 

In setting up a priority queue, for accessing modules and routines for 

< 

the present run. 
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Log Module will provide the user yith a record o.f his run, 
.including such information as the contro]. parameters used, and the 
action taken by the package based upon th^se parameters, as well as the 

i ^ 

date, costs, etc. of the run. In addition it T^ill give the systems 
analyst information to assist in further optimizing the package as a 
whole. 

The Input-Output Module will< handle specifications made by the user 
concerning input and output files and provide, him with a record of 
I-O operations. 

Jh ^^ranslate Module will utilize information provided by the user 
concerning the form of his input datfa, and change the input constraints 
reqMired of the processing module to a form compatible with the user^s 
data. It will provide him with a record of such translations ^nd/or 
error messages^ if his input speci fications are incompatible with the 
processing he has^equested . 



3.\^0 Interact Module 



The function of the Interact Module will be to act as an interface 
t 

between the user and the package. Interact will run as a front-end 
portion of the total package, and p-repare user c6nf:rol pa*rameters to 
be appended to the "input data which:-^w[4^11>-then be run in batch mode at 
the main facility. 

It will ask the user questions^ about the parameters of the run he 
is initiating and will utilize his answers to prepare computer compatible ' 
control parameters to be read by the Control Module. / 



ERiC 
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. Since it is a separately* functioftiing entity, it\ will serve as a - 
training program for initiating researchers itito the* use of thexj)ackage. 
As each control parameter is compiled -through the qi^estion and answer \ 
process, a correctly formatted" Transaction Language jcontrol statement 
will be printed ouf. The control statements also will be passed ' 
dire6tly to the Control Module.'^ The control statements will be ou'tpuj 

in a form appropriate for ' use as input to^^ the main package j>rograins , ^ 

? ' ' . ■■ -i 

such as magnetic tape. j: j 

After th^xresearcher has used th^ Intefaet Modiile for a while he 
may find that he iKsAif f iciently familiar wtth the reciuirements of t^he 
Transaction Lang uag^e Control to prepareVhis own control statements . 
without computer assistance/ Certainly, such user expettise is one| 
of th6 goals of the Intgj^t Module. As a teaching, as well as.^ 
functional wrogr^ffit will keep a running, count, of user success and 
failure inWe question answeVing process,^and output such itjformation 
to a systemg^^alyst whe^ polled. The systems analyst will use suclt 
information to modify and upgrade the package for maximum success 
i^thin the^^^iroranent of tke actual researchers maMng use of the 
systenf.., \ 



3. .2.0 Control Module' 



The function of the Cb^itrbl ^Module will be to read a set of control 
* Statements containing ruii"^ parameters>.^nd to peifom'^a decision making 
function for that rtin. 
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In any particular case, the ijser will speci fy- which package 
functions he. wishes to use, as well as his particular output specifica- 
tions. For example, he might wish to produce a KWIC, a rank-ordered 
frequency count and a parsing of his text. He will Indicate. his needs 
by means of Transaction Language Control .statements which preceed his 
input. data.> These TLC statements will €e produced either by use of the 
Interact Module, or (in the case of a sdphisticated user) directly. 
The Controt^Module will re^d the statements and compile a decision 
table which can be used byrthe program during execution tp determine 
which Function Modules will be called in which order for that run."* 

If* the "sophisticated" usqr has made' syntax errors in hi* prepjara- 
tion of the statements, the ControT Module will print error messages 
wh'ich will help him cprr^cT'TIls^'^eTrtyrs before re-submitting the job. 
'The Transaction Language will. be desigiied g^th at typical errors, such 
as the omission of a comma,- Rill be automatically corrected, allowing 
execution to proceed*. For sucn, correction^, a message will be printed 
xSn the output indicating the Assumptions made by the Control Module, 
helping th6 -user to verify that the Control Module has not misunderstood 
his intent. The idser will hav^ the option to specify that he- does not 
wish execution to proceed if assumptions were necessary. 

In Version I, the us^r will speci f>/ the form of his input data, 
such as record len^tti, qAder and location of variables (for Statistics 



Module) and estimated ^ize of data base being used. In latet Versions, 
the Control Module will scan this information and set parameters for 
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the run to optimize usage of computer equipment and peripherals. Suc^ 
parameters will control selection of I-a procedures , storage and access 
procedures, j^etc. Messages yill accompany the output, indicating the 
options used in a particular run. Provision will be, made for user 
ov^<5(ride of the defaults. \ * 

' The user will^also indicate special conventions used in his data, 
such as a slash preceding a letter to indicate upper case, or an 'V^PP^' 
preceding a character stream to indicate the beginning of a new P^^*" 
graph. - The' Control Module will evaluate the form of the input data, 
and decid^^ if sufficient information is piresent to allow the requested 
function modules to execute. • If execution is possible, it will detfefmine 
whether the 'Trans late Module needs to be "called. Messag.es will be 
output to the user indicating missing information which prevents execution. 
As in'pther cases, translation patameters for the particular run will' 
accojjipany^ output^. IT, the Translate Module is needed, the Control' Module 
will provide the input convention information contained in th*e T^feC . -^.^s 
statements. During execution-, the Control Module will use the decision 
\ table to access* appropriate Interface Modules in an appropriate order. 

Any or a^l of the interface Modules can bp called upon by the Control 
Kodule^ and the order and s-tructure of the calling procedure need bear 
no resemblance to the linear thinking of th^ user but can be structured 
in terms of machine efficiency for combination and ordering of functions 
required by the particular run. ^ 
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3.3.0 Log Module 

The function of the Log Module will be to provide th^ user with 
a summary of the processing in the present Computer run. It will provide 
the systems analyst with information concerning those subsections of the 
package getting the heaviest usage, allowing appropriate optimizations. 

The following information will be included ^n a Version I user 
log sheet : 

- The user's identification (name, cost center, etc.) 

- The date and time j 

- A listing of the TLC statements used 

- A listing of modules and routines called upon 

- Execution time 

- Input and output devices utilized ^ 

The following information will be included on atVersion I systems 
analyst log sheet: 

- All the items found on a user log sheet. 

» - Breakdown of in and odt times^ f or "eacTi^ *pfbt?edure * ...ri 

- Size of data base 

- Later versions will also show such things as internal storage 
allocations ' used 

3^.4.0 Input'Output Module 

The function of the Input-Output Module will be to allow the user 
to specify which devices will Ijandle his input and output, and to ^ 
provide the Log Module with a record of the I-O operations. It will 
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work in conjunction with the Control Module, as a Sub-Program. Default 
input will be from punch cards, and default output will be to high 
speed line printer. Inpft may also come from magnetic tape, or disk.- 
The input 'Module wiU'also be'used when input for one module consists 
of output from another (such as the Retrieve Module). 

All outpu,t will normally. go to 'the printer^ however, users may 
" have particular needs or .preferences anS may elect to use another output 
"^d^vice. 1 For example, the user may wish to save his "bufetH^-.-in some 
compure/compatible form for laten inp«t to some other -program. If .so, 
-he will sipecify output to' magnet ic taR^, or punched cards. 

Another, although complesi use of the output module,- will occur 
when the user wants his output to serve as input for another module • 
within the 'package itself. Here, the -output module not only will put 
the output onto a selected device, but also will put the data into an 
appropriate storage location within the system. * ' < 

■J . ^ . 0 Translate ^odul e 
•• .The fynction of the Translate Module will be to -provide the 

interface between the user's data and the data conventions require'd by 

the particular modules he wishes to use. Like the I /O Module, it may . 

436 viewed as a subprogram of the Control Module. 

Since it is extremely costly 'to convert a, large data base to . 

another format, the Translate Module will work in the opposite ^direction, 
, converting the rela'tively few program conventions to the format in which 

the data exists. Such a conversion will be accomplished iji the following 



manner : 
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Each of the modules will have an array associated with it which 

is accessible to the Translate Module, The arrays will each have a 

/ ^ * ^ 

dimension of 256, corresponding to the 256 possible 8-bit codes. Each 
position in the array will hold an octal number equivalent to the new 
value (the data dependent value)^which should be utilized by the 
par-ticular Function Module for the current run. The Translate Module 
will set up the arrays for those Function Modules being oall'ed by the 
current run, using the old va\je (thj^ Function Module dependent value) 
as a subscript to locate the appropriate ^sition within the array 
into which to store the data dependent value. For example, if the 
KWIC Module is written to expect a slash ("/") preceding each character 
which is to be taken as upper case, and the user's data has been pre- 
pared with a dollar sign serving the same function, an octal 133 
^'equivalent to an EBCDIC/'$'') will be placed in position 97 of the 
array sfssociated with the KWIC program, since 97 is the EBCDIC decimal 
equivalent of a slash ('7").-^ " ~ 

Each of the modules will have a specially prepared subroutine 
that initializes each of the program dependent variables (such as a ^ 
variab-^e ^'capital") to the value contained in the appropriate position 
in the array associated with that module. ' 



3 

EBCDIC codes have been used, since the UCLA computer facility is a 
likely one on which to set up the package. The same algorithm could 
be used with a (fomputer which uses ASCI-:^, with an octal 040 being 
placed in position 47 of the array. 
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The utilization of the general purpose array^ will allow great 
flexibility when a new Function Module^is to be ad^ed or substituted in 
the system, since a completely different set of input requirement^ ma.y^ 
be accomodated without modification of other -modules in th^ package. 
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4.0.0 DATA MANAGEMENT FUNCTIONS (seeVigure 3) 

Data Management Functions a^ie thoseXfu net; ions performed by the 
package which will be, primarily concerned wiNth assisting the usep>in 
the preparation of his input data, an4 arranging his output in a form 
which will best facilitate his research. Seven modi>i€s will perform t 
Data Management Fuae^^^ns . They will be Verify Moduld, Compare Module, 
Assist Module,^^^etrieve Module, Sort Module, Merge Module, and Tables 

Modu le . ' ' ' 

The Verif^ Module will provide the user with tests of keypunching 
accuracy,, and will^ flag obvious errors such as the use of instead 
' of ''1" within a numeric string. ^ » ^ ' , 

The Compare Module will test one text against^ another and- will 
flag differences which occur. ^ 

The Assist Module will allow the user to have the computer 
identify and flag, in his input, specific items on which he needs to 
take special action by hand coding. 

The Retrieve Module will give the user the capability o£^ pulling 
out a smaller section of a large data base according to specified 
ciriteria which apply to that section and not to other sections of the 
total data base. Such a retrieved subsection can be used as input to 
other modules of the package. 

The Sort Module wi 1 l^earrange the output frc?m a processing module 
into an ordef ^def ined by the u^e]r. ^ 

The Merge/Module will rearrange the output from various preyioua 
processings into a single output in a form defid^ed by the user. 

- 34 
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The Tables Module will prepare. output in tabular form, according 
to. row and column specifications given by the iPser. 



4.1.0 Verify Module 



The function of the Verify Module will be. to check on keypunching 
accuracy where errors might invalidate research results. The user will 
be able to specify in a TLC option statement one or more of the fol- 
lowing data verifications: ^ 

- Numerics imbedded in alphabetic strings. 
J- Alphabetics imbedded. in numeric strings. 

- Unmatched parentheses or other pkired delimiters (user must 
specify what delimiters). 

- Strings greater than 16 characters in length. 

- Use of "illegal" characters (user specified). * 

. Default will be for the program to check all thie i ferns , Qutput from 
the module will be in the form of location information and type of 
error, with enoug'h context given to '^clearly identify ^t^fe error for 
correction. * * 1 " 

4.2.0 Compare Module' ' . . , 

The function of the Compare Module will be to allow the ^usek to 
obtain iaformatipn on the correspondences between two texts. Outpir^ 
will be in the form of an alphabetical list of words appearing in text 
one with their locat'tuns, fol loved by a 1 ist/ of ! words in text two which 
appeat^ at the same relative locations, but are different froiti those 
appearing in text one. 

35 
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Such lists will be headed with the user supplied identifier for 
each of the texts compared, and the date the comparison was made. An 
overall consistency quotient will given, which is the ratio of^. 
identical .words/total words, ^ ^ 

4.3.0 Assist Module 

The function .o f the^^^Asg l^ allow the user, to 

ha\^ the computer identTfya^ flag in his input specific items on 
which he wishes to take special action by inserting hand coded 
information. 

The user will specify alphabetic or numeric strings which he 

■ ^ ^ ■■ 

wishes to have identified and flagged, and he will identify one of two 
ways in whiqh he wishes them flagged for his speplal handling (either 
by the insertion of 10 blanks immediately followi-ng the item, or by 
the insertion of a user defined special flag symbol). 

The Assist Module will &can the text for the specified strings 
anii\produce a new text fjJr^with flags included. By use of th§ Inpllit- 
Output^ Module, th^ user can specify the device on which the file .is to 
be saved. Default is to print the file on the line prir^te^. The user 
may specify the number of copies of outpu^ he wishes. 

4.4.0 Retrieve Module *: ^ 

The function of the Retrieve Module will be to allow the user to^ 
search a sequential or*an inverted file using either a Boolean cdmbina 
tion of terms, or a list of numeric identifiers and to obtain subsets^ 
-of information contained witViin th^t data base. 



A sequential file is one arranged in "nortnal" order, with a seri^fes 
of sets , of related information following each 'other sequentially. An 
example of such a file would be a personnel data base that would 
contain a sequence of sets of information such as name, address, 
edvication, salary^ ^afce^ employed, etc. -for each employee. \ 

An inverted file is similar to an inde3^Ja:i>-m2ltiy^^y«^>^ 
arranged by sub-category, aniklists the location of atl occurrences c^f 
information relating to the sub-category. For example, such a file 
would have an entry for salary* $15^,000 and would list the locations 
of full references on all employees with that yearly income. 1 

A search utilizing a Boo^ean>' combination of terms could j^leld^ 

\ 

Such itif^rmation as all those rlgferences where AGE = 3d ^and EDUCATION 
MA OR PHD AND SALARY = $1^^000. , 

■ . y ' ' ' 

4.5.0 Sort Module ' 

The function of the Sort Module will be to allow the uTSer to 

specify particular regular orderings for his"' i%put or output. ^ 

VersiopI options will include: v 

Ascending (i.e. A-Z or 1-1,000). ' ' - ^ 

/ 

- Descending (i.e. Z-A or 1^000-lV,* ^ * 

V ' 

- Combination (i.e. several sort fields, with different options 

for eachX 

Later versions will include an option for reverse word (ex. 
all wor4s ending in d together, with ed words before id words, etc.) 

37 
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The user will specifv»\^ fields on which he wishes sorts tq be 
performed", with the de^fault being' one, iield only consisting of the first 
16 charact'fers^of the record. He will sp.ecify the type of sort he wishes. 
Certain modules which re&ularfy require sorted output will have their 
ovm 'defaults. For example, -kV^C output will be sorted, in ascending. 
al<phatietical order on icevwoi^ds, and ascending OAimeric order on locations 
\vkev^or(^|s are the same; frequencies- will^e sorted in ascending alpha- 
betical order on the word field if the ^^AUpha" optic^n is inv.oked , \and 
descending numeric or^i^' on-th^--fFBqufipcy field, if the "Rahk" option is 
invoked, - * ^"^ 

h .0 Merge Module 

\ The function of ' the Mer^ Module will be vto rearrange the output * 
from varioik previous pr^ocessing steps into a singU mitput. The most 
common u^^f this module will be for the production of merged KWIC 
and merged Tables, although it may also be used with such modules as 
the List Search Module to help the us^r establish larger dictionaries 



A . 7 .'O Tables Modute ' - ^ 

The function of the Tables^ Module will be to allow the user to re- 
format information gathei^ed from the Data Processing Modules, in order 
to make relationships within the output more easily apparent. 

For example, if thfe user has obtained frequencies and percentages 
of numeric codes by usingj the Frequency Module, he will be 'able to make 
a table where closely related codes appear in vertical rows and the 
sub-categories of ^those codes appear in horizontal columns. 
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In the example below, codes .10-19 appear in row 1, 20-29 in row 2, 
and 30-39 in row 3. Relationships between the number of occurrences 
and percentages of codes 15 and 25 may become clearer b^ looking at 
column 5 (subcode 5) . 
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Vers ion I Oif Tables Module will allow the user to^ indicate appro- 



priate headi^n^ for his \ tables^^'^d to specify which values shall 
appear in row and column ^pf^'ition&. ^ ^ ^ 
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FIGURE 4 . 
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5 0 0 L. A. P. SPECIAL PARAMETER FUNCTIONS 
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5.0.0 S^PECIAL PARAMETER FUNCTIONS (see Figure 

Special Parariieter EOnctions will be those functions performed by the 
package which tare primarily concerned w^ith- def;Lnition of limitations on 
portioasi of thcd^ta to be processed, or unusual applications c/f package 



processing modules. In 'e^i^ I twc^ modules will perform Si/eclal 
Parameter functions./' They ^^e: List Search Module and Sen^tive Module. 

Th^ List S*^earch Module wilt allow the user to define lists of words 
or pKrasefi which shall *be either included or excluded, from the processing 
requested. . ' , , ' 

^ The Sensitive Module allows^ the user to specify particular contexts 
withirt which, and only within which, processing is to be done.^ 

<f • . ' 

5.1.0 List Search Module 

' ' \ » 

The function of the List Search Module will be to allow, the user to 
specify at run time particular strings falphabet ic or numeric) which shall 
be either included or excluded from the processing. Such, sets of stVings 
will.be input ^n the form of a list which preferably will be alphabetized, 
atvd which will be preceded by a system control card specifyi^ng INCL or 
EXCL. ^, 

INCL. Specifies that processing shall *be done only on strings ^ 
wh'ich appear in the following list. All other strings shall be ignored^. 

EXCL.^ Specifies that processing shall be done on all< ' s trl^ngs • 
e xcept those which appear in the following list. Those strings in "the 
list shall be ignored during processing. 
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The TH^ - EXCL option will allow the user to optimize production* 
costs by processing only the data which is ^^ential to his particular 
application. The INCL - ,EXCL option shoul^ be used with care, espec- ^ 
iallv in conjunction with Sensitive, Content/and Parse since errors can 

occur if data pertinent to the^e processors is omitted through excessive 

^ ---^ 

limitation of the data to be included as input. » 

/ ■ "/ I - ■ ■ / 

5.2.0 Sensitive Module ' ■ ' • / 
"7 * ' ^ 

The function of the Sensitive Module will be to allow the user to 
define adjacent contexts which specify parts of the input te^t to be pro- 
cessed. For example, a liser mi,ght want^ to process the word "reading*' if 
and only if the word "remedial" preceded it. Or he might wish to process 
only the words occurring within the Title of a library citation. 

The user will specify: ' - 

- The string (alphabetic^ or numeric) which provides the Key for 
processing. 

- The string (alphabetic or numeric) which provides the sensitive 
context, * ' . 

- The maximum distance (in ^number oiC characters or number of words) 
frrtn the Key within which the sensitive context must occur, 

- The direction rieft or right) from the Key in which the sensitive 
contexts must lie. 
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FIGURE 5 
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6.0.0 DATA PROCESSING FUNCI^JONS (see Figure 5) 

Data Processing Functloii^s will be those functions performed by 
the package whic;i will be primarily concerned wJth *the ^actual Analysis 
of the input d/ta. and the production of information which will furtj|j^r 
the user^s research effort. Ei^ht basic modules will perform Data Pro- 
cessing functions. Thev are: Scan Module. KWIC Module, Frequency 
Module. Index Module, Par^e Module, StatisticR Module, Content Module 
arrd Morphological Analvsis Mo<Jul«. ^ • . ^ 

The ScaTTlodule win be the heart *of the data processing functions. 
It will read text In. scan It character By'character,^ and establtsh 
word boundaries, etc. 

Tjie Kmc Module will produce a Keyword in ^Context (Concordance") 
Hating of 'the data, allowing the user to specify any one of two basic 
o,.rput formats, and^ the desired length for the before and after contexts 

The Frequency Module will produce information on the number of 
occurrences and percentages for words, phrases, and code's within the 

' ft 

^text, \he user may sped fy alphabetical ordering or rank ordering. 

Tbe\ndex Module wllUproduce an alphabetical index of the loca- 
tions bf rXf^rences to particular words, phrases or codes. The user 
will be able' to specify the tetms in Which locations will be given. 

The ParseXModule will provide the user with Information concerning 
• the grammatical Vructure of his input text, in the form of a tree 
arrangement of sut'^ace and deep structures. 

The Statistics Modulewill produce numerical analyses of such 
Items as mfeans and standard deviation of word length, sentence length, 
paragraph length and numerous others. 

■ u ■ 



The Content Module will allow the user to develop semantic cate- 

.gories, and test his data against them. • 

* ^ / 

The Morphological Analysis Module will allow the usar t/ obtain' 

• • ' <> 

listings of root words contained within his text. It will be used' 
primaVily in conjunction with other processing modules, such as. Parse. 

6.1.0 /Scan Module ^ ^ 

Version I of the Scan Module will function\s aVftont end*' for 
several of Ihe processing modules (KWIC, FREQ, etc.). \i\ce it will 
be heavily used, and since it, perfonps Ifs decisibn makir^ jSunction by 
scanning character by character through th^ input testt, speti\l ^tentioh 
will be paid to problems of j^optimlzation. major objective |s three- 

fold. It will read in data as necessary from the input stream;\i\ wi 11 ^ " 
find and return to the calling program the beginning and end poin^s\of 
a word; and it will determine if the ^elimUer(s) following a word is a 
"special'* character which signals the necessity of some kind of special 
handling involving an additional subroutine call. 

Depending on the calling module. Scan may return either the begin- 
ning and ending points of the wprd, or the word itself for storage in 
an array. * ' 

V The user will be able to specify a definition of characters to be 
considered* as valid word-parts. Default will be to haVe the alphabet, 
apostrophe, hyphen and numbers considered as word-parts with all other 
characters considered as delimiters. In addition, the user will be 
able to specify ^which of the delimiters should be considered as "special" 
characters. , 



h.Z-0 KWIC Module ' ' ^ ^' ' ^ 

— ' ^ ^ ' ■ * / * ■ ' 

^The funceion of the KWIC Module 'is' to produce Keyword- in-Co^text 
Jironcprdance) 1 is t ings' f rom the input text. Location inf ormation>^\il 1 
O^roken down into four main categories: level 1 (ex. Document ID), 
leveT^ (ex. Page), level 3^^ paragraph) , *and 'level ^ (ex. li^e). The 

KWIC Modkle will be run Trequertt^, in conjunction with the List Search \ 
Mo^lule Onk such, application will be when producing KWTC's or librd>^y 

A 

c i tat ions wherXonl^ words in the title will be '.Iprocifessed . ^ ^ 

The user may ^^cifv\he following: ' * 

- Length of be f orec*neext to be specified either in numferer of. o 
words or number of characters. (default, is 48 charaGters) 

- Length of keyword. (default Is 16) / 

- Length of aft6r context to be specified either in number of words 
or in number of characters. (default is 48 ipharacters) 

Sort fields and ordering (default is keyword, location, in 
ascending order) { ^ " * 

- Either of the following two Oiitput formats: \ 

A) one line, keyword centered^ 

B) two line, keyword right justified 
(default is A) 

- ■ , ^ V ■ 

fS.3.0 Frequency Module^ 

The function of the Frequency Module'wiU be to produce alphabetical 
and rank ordered computations of the number of times words an^/or numeric 
codes occur, and .what percentage of the total text is represented by each 
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>^ The user may specify th6 ^llowii 

- ^phabetlcal ordetfing of the list 

fi^t> . ^ • 

« 

- R^nk ordering of the list, (most frequent first) 

- Occurrences only. 

- Percentages only. 

Default will be for the Module to produce all four. The Frequency 
Module will be run often in conjunct i^on with the Tables Module to pro- 
due^ a tabular presentation of the information in a user specified " 
format. ' . 

9 

6.4.0 Index Module ^ J ' • ^ 

The function ql the Index Module will be to allow the user to 
compile an Indes^ of locations jof specific words and phra^ses within his 

' 9 

text. ^ The module^will generally be used in coajunction with the List 
Search Module. 

, ThfB index produced will be alphabetically sorted. The default for 
locations w^,ll be the same as for the KWIC Modtile (se^ 6.2.0). ^"If no „ 
inclusion or exclusion list is provided by the user, a s'tandard exclu- 
sion list will be used which consists of high frequency words Such as 
/•and", "the**, "ia", "by" etc. 

6.5.0 Parse Module 

The function of the Parse Module will be to provide the user, with 
information concerning the grammatical structure of sentences contained 
within the Input text. 
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The user may provide his own grammar and dictionary in a format ^ 
compatible ^ith the prcT'gram parameters. 

Output is in the form of tree-structures representing the surface 
and deep structures of the sentence's. 

The Parse Module will be run in conjunction with the Morphological 
Analysis and l.ist Search Modules. 

The Parse Module should be used with c^are, since processing costs 
for large input texts are often high. 

f).6.0 Statistics Module 

The function of th^ Statistics Module will be to allow the user to 
obtain summary^ ihfoormation of a statistical nature concerning his input . 

text , y : ■ ' * ( . 

following are some of the more obvious stati/stical measures of text: 

- Total number of occurrences of each mark of punctuation. 

- Total number 'oi words in text. 

- Total number of different words. 

- Ratio of unique/total words (type/token ratio) > 

- Frequency of words of length n (where n ranges from 1 to 24 
characters) . 

- Frequency of sentences of length m (where m ranges from 1 to 
40 words) . 

- Total number of sentences in text. 

- total number oi paragraphs in^text. 

- Mean, word length in sentences. ^ , 
• - Mean sentence length in wor'ds. 
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- Mean paragraph length in sentences, 
-j^tandard deviation of word length. 

Standard deviation of sentence length. 

- Standard deviation of paragraph 'length. ^ 

- Third moment of word length. 

Fourth moment of word length. • 

6.7.0 Content Module ' , . ^ \ 

\ ■ ^ . - 

The function of^ the Content Module' will be to^^llow the' user to set 

' • » 

up dictiorfiaries of phrases in nilmerous «emaa,tip. categories, and to* 

match his particular text against one or more of these dictionaries and 
have a category item analys^s^ performed. A t^abulation will be given by 
category pf the matching items and the number of occurrences.. For 
example, a user studying the relationships of Mexican American oriented 
state approved text books may want to make phras^ dictionalt'ies for 
semantic categories -such as "nuctear family", "extended family", 
"individualism", "sopializatiion" . "present orientation", "future 
orientation", "patriarchy", -"matriarchy", "cooperation", and "competi- 
tion". By using the Content Module, he could determine the concept 
weighting which occurs. 
6.8^0 Morphological Analysis Module 

The function of the Morphological Analy^^is Module will J)e to allow 
the user to obtain information concerning the root words contained 
within his input text. Generally, .t,his modu^le will be run in conjunction 
with other modules such as Parse and List Search but the user may obtain 
a toot word list independently of othet module uses. 

49 
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7.0.0 TRANSACTION LANGUAGE CONTROL C^.L.C. ) : 

^ ' The function of the Transaction .Language wilT be to provide; the ^ 
user with a method of coranunic^ing paramet'ers; fbr operating the- 
computer 'run, It w;!! allow the user to specify the fortn -of 'his Inpuf 
data, the package functions he wishes ttTuse,' specific options he ^ 
requires, and'the form of output he wishes to obtain. , . 



) 

,. • - • - / 

. - * 



7.1.0 General Conc^epttSy /• ' ». . ^ • - 

*• The basic- design bf the 'TtC :empha.sizeV.eaBe •c.f .l.^e.. • Therer-aTe few 

.svntax constVaiitts-. With ' the • Except ioiCb:# the initiafl -identi-fying •• !" 

"in column 1, parameters may.-bl In A relatively free format forin. After 
Che -Control Word" (RUN, FUNG, OPT, etc.),- required sub-items 'of l/f6r- 
mation may be in any order. Imbedded blanks are ignored so the fiser 
mav format his TLG cards as he wishes.. If a command is misspelled, the 
system will make a "be^ guess"^ased on the context and the firk two 

..letters, and will print its "guess" or a message indicating that \t has 
insufficient information to continue processing. • ^ 

7.2.0 Required System Commands 

All TLG cards will begin with a "!" -in column 1. Continuation 
cards will be indicated by '"!" in columns 1 and 2. 

The following six "Control Words" will be required for any run 
„,ade with the package. The Control Word must be 'the first item follow- 
ing the exclamation point, but need nOt be L any par ticular column. 
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- IRUN 

- ! INPUT 

- !FUNC 

- -lOPT 

- ! OUTPUT 

- II 



IRUN . 

The IRUN card will tell the system that ,a run is being initiated, 
Ahy information punched on the IRUN card from columns 6-80 or on contin- 
uation cards Vill be used as run identification and will be printfed at 
the top of each page of output. No mbre-than two continuation cards 
Vill be allowed. 

! INPUT , . 

The !INPUT card will specify any special parameters 'of the user's 1 
input. The following information must be included on the IINPUT card ^ 
and/or its continuations: ^ 
Input record length 

- Input device (magnetic tape, cards, etc) 

- Code used (ASCII,, BCr, EBCPIC) ^ 

- Special conventions « 

(•PG - NEW PAGE; ll\ « tPPER CASE; etc) 
Any number of continuation cards may be used, ' 

!FUNC 

The IFUNC card will indicate which Data Management and Data 
Processing functions the user wishes to employ. Following is a list of 
acceptable functions artjich may be specified by the IFUNC card; 
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- COMPARE 

- ASSIST 

- RETRIEVE . 

- SORT 
-MERGE 

- KWIC 

- FREQUENCY 

- INDEX 

- PARSE 

- STATISTICS 



- CONTENT 

\ 

- MORPH 



^ - LIST SEARCH 

One !FUNC cardi will b"^ required for each function emjployed, and it 
must be followed immediately by its assci^ciated, !OPT card. However, the 
two-card 'Vsets" T ! FUNC and !OPT) may occtir in any order. 
!OPT 

The !OPT card immediately follows the IFQNC card and is associated 



with it. An !OPT card without a preceding fFUNC card will result in an 
error message and vice-versa. The fOPT card will associate a li^t of 
appropriate optibns with the functions requeated. For eicampl^, one 
option of the KWIC function is the use of an inclusion or exclusion 
list; one option of tlie Frequency function|is a rank-ordered list. 
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The lOUTPUT card will specify what output the user wishes to 
receive, and will allow him to direct his output to whatever device he 
desires. He may suppress Log output and summary diagnostics if he 
wishes </ft is this card which will specify the destination if the 
outpujf from one function (for example Frequency^) is to be used as the 
input for another function (for example Tables), 
! DONE 

The tDONE card indicates that all TLC cards ffave been input and 
the user is requesting compi:^tion and e^cution. All cards after the 
!DONE cafd^^ill be considered input data. 

ujO^O^ SUMMARY AND CONCLUSIONS 

Jhe most important features of the Language Analysis Package will 
be adaptability crf-TTimturar design and flexibility of user-defined 
optiijns. 

Individual portions of the package will be used without the user 
being penalized by high processing costs duetto superfluous modules 
being called. 

Development costs will be held to minimum by utilizing existing 
programs already written and, debugged by 'specialists in the field of 
natural language processing. 

' Documentation also will be modular, and will develop organically 
with the growth of the package. At every stage documentation will be 
produced reflecting latest developments and most recent revisi^ons. 



The value of the L.A.P. will lie in the research opportunities it 
will open for the non-computer oriented researcher; who previ-ously^ 
no ready tool to do analysis of textual data. 
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Working Paper 2 

DEStGN DOCUMENT: CONTENT MODULE-\-L.A.P. VERSION I (TN 5-72-35) 
Ann Porch and Fat Lang 

^■. 

This document is one of a series of programming design specifi- 
catiofis for indivi^u^l modules of the Language Analysis Package 
(L.A.P.)-^ The se^ption of the'system design to which it is related v 
is 6.7.0. ^ ^ ^ " ^ " - 

V 

Program Objectives ' \ ' • * 

\ Version I of '^the Content Module will function as a semantic . 
:o\itent analysis module by allowing the user to construct any 
number of sorted dj^ctionary^ files using phrases and/or single 
words .2 Each dictionary file will represent a set of use^-defined 
semanbic categories. The program will "score" the inpu*. text by 
matching it against the dictionary and give the u3er the total 
number of dif f erent' cal:egories a parei^cuTar word or phrase falls 
into, as well as the categories in which it falls. 




ISee TM 5-7X-06, "Language Analysis Pack'age (L.A.P.) Version I 
System Design, " f oiy an overview of the" package. 

A- 

A modification \)f an existing program will be used for the 
■rp ' Version I Content Modul\^^^The )^ogram is SCORTXT, developed by 

herald Fisher of the UniversHy of Connecticut. Full d<}cumentation 
on the program may be found in Fishes "The SCORTXT J^rogram for the' 
Analysis of Natural Language," University of Connecticut, Bureau 
of Educational Research. 55 
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Constraints and Limitations 

- When th^ text is scanned for dictionary matches, only the 
longest string will be matched. For example, if the dictionary 
contains both "not very much" and "not very," the text phrase ^ 
"not very much" will be 'counted as matching only "not very much". 

- No punctuation (except apostrophes and hyphens) may be included 
in -dictionary phrases. Texts longer than 1,500 words must be broken 
into sub-texts if high-frequency words are category entries. 

Options and Defaults 

» Options and defaults for the Content Module will be as follows: 

- Print text in original form (Default = no print) 
Print text in array^form (Default = no print) 

- Print sorted dictionaries (lE^e'fault « no print) 

/ ■ / . . \ \ \ 

- Print a reduced t^xt (Default\^« no .prl^t) 

- Print an item an/klysis '^f^each ^^ategory^Def ault = print) 

- User specified word length for t^t in array form 

(Default - 16) \ 

/ \ 

- User specifie^d input record margins f or^ text (Default = 1,72) 

i /' 

Data Fil^ Specif icationg • ' \ ' 

, InRut files for 'Vers'ion I must £ollow the ordering .shown 

\ 

in Appendix A. Dictionary input will consist of one br more dictionaries. 

Output" for Version I will consist^ of punchedW printed 
output' as shown in Appendix^ B. * - \ 
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Significant AlRoritlime 
Category Indicator Algorithm: 

After a dictionary is read in and sorted indernally into alpha- 
bet ical- sequence a bit string will be created for each dictionary 
entrv with on-off iniicators for each category represented. Thus 
It the dicti-onary ha,s 1,000 entries which fall variously under five 
categories, then for each of the I. 000 entries a bit string of length 
five will be created withe's in each category position to which the 
entry belongs. The sorted dictionary and the dictionary bit swings 
are added to the file DICT. 

Si^gificant Variables 

There are no variables of special significance associated with 

the Content Module. 

Error and Other Messages 

The following messages are printed out by the Content Module^ 

- "Dictionary Not Found'' if there is no dictionary associated 
with the input f»r a particular run. <i 

- "End of Jo^" if the run terminates normally when there are no 
further texts to be read. ' . *♦ 

Called by and/or Call , , 

The content Module is- called only by the Control "Module. 
• Th% Content Module will call the following internal subroutines; 
'• - ARRAY * . 

- DIN IT 
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Working Paper 3 

DESIGN DOCUMENT: KWIC MODULE --L. A. P, VERSION I (TN 5-72-37) ^ 
Ann Porch 

This document is one of a series of programming design specifi- 
cations for modules of the Language. Analysis Package (L,A,P,)» It. 
related to section 6.2.0 of the Version I system design document.^ 

Program Objectives 

The function of the KWIC Module will be to produce keyword-in- 
context (concordance) listings from the input text. Such listi-ngs 
will contain location information whioji will be broken down into four 
main categories: level 1 (ex. Document , ID) , level 2 (ex. page), 
level 3 (ex. paragraph), and level 4 (ex. line). The KWIC Module 
will usually be run in conjunction with the List Search Module and 
inclusion or exclusion dictionaries'^ It may also run in conjunction 
with the Sensitivd Module with user defined limitations on the portions 
o£ tha input data to be presented. ---- J 



Constraints and Limitations 

There will be no constraints or limitations for input data for 

the KWIC Module, other than those described in design • specif ications 
for the Scan Module. ^ 



ISee TM 5-72-06, '^Xanguage Analysis Package (L.A.P.) Version I 

System Design." ^ 

2see TN 5-72-27, 'Design Document: Scan Module- -L,A,P . Version I, 
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Options and Defaults ^ 

Options and defaults for the KWIC Module' will be as follows: 

- Length of before context. The length of context will be 
specified in number of characters. (Default = 48) 

- Lejigth of keyword (Default = 1)5) 

- Length of after context. The length of context wil,l be 
specified in number of characters. (Default — 48) 

- Form for identifying location information within the input 

f 

text. (Default=f?TXT for level 1;,@PG for level 2; @SEC for level 3; 

t . 

and a computer generated count of inj^ut records (lines) for level 4) 

- Sort fi'eld and ordering (Default =5keyword, location in 
ascending oirder) ' ^ 

- Output formats There will be ,^ two choices: A.) one" line,- 

\ ' ; .| 

keyword centered^ and, B.) two line, Iceyword right justjLfied on 

line ,1. (Default = one line, keyword centered) 

■ n 

i 

Data File Specifications 
Input 

*i - , ■ ij 

Dat^ will be input to the Scarf Module and'will be considered as 

a stream of characters. No notice will be taken of recdrd boundaries 

Data which has been prepared utilizing other conventions can be 

handled tjy use of the TRANSLATE Module. 'The, SCAN Modul^ will be used 

in conjunction with the KWIC Module. It will ^reak the- text into 

words aqd check for special characters needed by sub-routines 

handling location information, etc. Parameters passed from SCAN to 



KWIC will be t^xt array identification, and the beginning and end \ 
point of the word. 

Output I 

Output data will /fall into one of two user specified formats. 
An example of each i^ shown in Appendix A. Output may be obtained 
on the 'high speed printer, punched cards, or magnetic tape. 

Signifi cant Algorithms 

" ■ ; " I 

There are three significant algorithms connected with the KWICu 

" . . ' \ 

Module. They are: 

9, 

- The Three Record, Circular . Read Algorithm (described more 
fully in '^Design Document: Scan Module - L.A.P. Version I") 

- The Contexting Algorithm ; 

- The Location Information Algorithm 

Three Record, Circular Read Algorithm. To find the context, 
the specified length of the before context will be subtracted from 
the pointer value for the beginning of the word. The result will be 

f 

Stored in a variable indicating the beginning point for the context. 

Tcf find the remaining portion of the^coAtext, the after context 
length will be added to- the pointer value for the end of the word. 
The ^f'esult will be stared in a variable indicating the ending point 
for the context . ^ 

A test will be made tjO determine if special action needs to be 

taken because values\)f either of the variables indicating beginning 

' 'I 

I point and ending poitit for the context fall outside the? bounds of 
Ithe array. If so, special action will be taken, as described later 
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below. If both variable values fall within the bounds of the array, 

# 

the context ipay b^ output directly from the array itself to a file 
for later sorting. A standard, implied-Do type print statement iQay 
be used* ^ j ♦ . 

If the value of the variable indicating the beginni^jg point of 
thj^ context is negative, special handling is required. The neg^tive^ 

/Value will be added to the upper bound of the array and the result 

/ ^ . " . C 

/ stored in the begin-context variable. When the context is output to 

the file for. later sorting, the print statement will ha^e, two parts. 

First the array values from the value of beginrcontext variable to ' 

the end of the array will be output. Then the array values from 

position 1 of the array to the value of the end-context variable will 

be printed. 

I If the value of the variable indicating the ending points of the 
context is greater than the upper bound of the array, special handling 
is also required. The array's upper b'ound value will be subtracted 
fron^ the value of the end-context variable and the result stored in the 
end context va;riable. Again, when the context is output to the file 
for later sorting, the print statement will have two parts. As b^fipre, 
first the array val.ues from the value of the begin-dontext variable to 
the end of the array will be output. Then the array values from position 
1 of the array to t^e value of the^end-context variable wi^l be^Vrinted. 

The Location Information Algorithm. Variables will be set up for 
. each of the following four levels of location information: _ 
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- Level 1 (ex. document ID) 

• - Level 2 (ex. page) » 
.- Level 3 (ex. paragraph) 

- Level 4 (ex. line) 

The user will specify a flag character (which must not be the 
same as any of the characters he has specified as valid word builders) 
and up to four following characters to indicate the furtCtion he- is 
indicating. For example, the user may Specify t(^at\till Ideation 
information will be f i-agg^d.with an '^'[.I we may\Vt^ pages with , 
"ipG" and Paragraphs 'ViPAR". . 
; . The SCAN Module^'will pass to the Location subroutine the infor- 
mation that it has found a special character. The Location subroutine 
will then check to see if the special character found matched those 
which the user has specified as meaningful for the KWIC Module. If • 
so, special aj:tion will be taken. Variables will be 'set up for values 
for each level. Level l-V^. document ID) ident i*ie^wili consist 
of' three alphanumeric chara¥t>J^ supplied from the in^Kit . stream. 
(Default - TXT) All other .vLr lab l^^^riU 11 be coiinteYs. Counts for 
Level 2 indicatorgwill be dependent on Level 1, an'd will be restarted 
whenever a new le\l 1 i^^dTEatlj) is found. Likewise, counts for 
level 3 and. 4 indicators will b® dependent on level 2, and be restarted 
wheAever a new level 2\is enpountered. J ■ 

• For output, Uhe c|!rff\ents of the fdur level variables will be 
introduced into the ou^put^stream in the positions appropriate to the 
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output format option chU^en by the user. | 

Significant Variables \ ^ 

There are four significant yarlables In thd KWIC Module. They ar^: 
-Three Record Array , " 

-Pointers to word beginning and end 

-Pointers to context beginning and end ^ \ 

-Four variables for the levels^ of location inStnnatlon 

Error and other Messages ^ ^' ' 

The fpllowing messages are printed out by the KWIC Module: 

- "End of Job^* if the run terminates normally when there are 
no further text^ to be processed. 

Called 'by and/or Calls * 

The KWIC Module is called qnly by the Control Module^, * \ 

0 

The KWIC Module may call the following other modules: " 

- List Search ( 5 . 1 .0) «optiot!fel 

- Sensitive (5.2.0) optional . * 

- Sort (4.5 .0) alway^ called 
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Working Paper ^ 

OVERVIEW OF IDCMS DESIGN OBJECTIVES . (TN^-72-50) 
Frank T\plitzky '^:;.>, 



^ 1 



The Instructional Development Control and Monitoring System (IDCMS) 
IS a powerful and flexible tool that permits researchers to "random 
access" audio and/or video Inst-ruct ion^l segments for purposes of ex- 
perimentally assessing and intensively analyzing the elements of these 
Segments. IDCMS contributes both to the technology of instructional 
researcli and to the devc^lopm^it of specific instructional programs. This 
document describes the foundatio^v upon which IDCt^P^^s built &nd the 
phases in which it will'be develdped. The phases are necessarily tentative 
since technological advancements and special user requirements will 
.HKlouhtedly modify current developmental plan?^ ' , 

Kvolution of system architecture . The hardware foundation for 
building SWRL IDCMS capability was configured by AMPBX Corporation to 
SWRL specifications prepared in consultation with ASCI of Palo Alto. 
This configuration; termed IDCMS Version I hardware, is shbwn in Figure 1. 



An important consideration in selecting Version I hardware was that ' 
it be of modular design to avoid obao^A^sence and that it permit functional 
as well as modular growth of IDCMS. Each increment in capability with 
be achieved with configuration hardware, computer software, and terminal 
design enhancements to provide the functional characteristics necessary, 
for a range of educational R6eD applications. v . ■ ^ 
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. ^ PHASE I 

4- " . 

During Phase I , SWRL Computer <C enter staff will develop IDCMS 
ot)erating pracedures and skills necessS^y to work with IDCMS hardware 
and software components, A limited but powerful set of functions will 
be made available to Laboratory researchers . so that moderately complex 
^Experiments can be run. Phase I operations wiU generally include: 

1. Presentation of audio and visual stimuli to a user^ according 

preprogrammed instructions stored in a digital system 

. controller. ' ^ 

2. Mixing of video tape and character generator -infqrmat ion tor 
presentation on portable TV monitors at user termiii^ls. 

3. Pr^^s^ntation of pictorial and alphanumeric visual information, 
in color or black and white, on the TV monitars. 

4. Control of the rate of information presentation by terminal 



" operators . 

' b. Synchronization of visual and aural/presentation sequences. 

6. Immediate access to all analog information stored in the system's 
master storage components by all terminal users. 

7. Recording of user ' responses entered via a portable keyboard 

for off-line analysis. 
The basi^omponents of IDCMS, as depicted in Figure i, consist o£ 
system contro^r, an audio subsystem, a video subsystem, and terminal 
stations. ^ The subsystems are briefly described below. 

SYSTEM CONTROLLER 

The system A.ontV<filler is a NOVA 12(K) Mini-computer, a general 
purpose digital computer processor manufactured by Data General Col-porat ion, 
Its'primary function in IDCMS is that of system controller of all ^^MS 

, ■ _ 74 . 
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4 

elements. Each user termiAal is ir\terfaced to t\\v controller, and the 
cofnniia'nd and control linka^ej between ^he keyboard a*nd all other IDCMS^ 
elements is through the controller. Linkage is established by either 
preprogrammed instruct ioiTp stored in the audio buffer in digital code 
form, or by operator commands. For example, a request for a par^Jjicular 
, audio/video program is entered by pressing the required program ijdent- 
itication luimbeTs on tlie requestor ' s .keyboard . i'his action transfers the 
request to the controller, which initiates duplication of the projgram 
at x.\\Q. user terminal. At-ter transfer, the user keyboard is placejd in 
a control mode to provide complete control of the audio buffer assigned 
to that keyboard. Each device in IDCMS has a cootro^ interface %o the 
controller for status sensing and control functions. The control 
interface serves as the dii^ital multiplexer for the controller input/ 
outpLi't bus.' The co,nt ro 1 ler ,s t ores digital data on a digital magnetic 
tape drive anciirdn a 2.5 million character digital ^isk memory. Special 
control interface units are prov,ided to permit data transfer between 
t he>se .LU1 its and the controller. in addition, an interface to an 
alphanumeric chciracter generator allows textual inputs to be super- 
imposed upon video displays. , 

AUDIO SUBSYSTEM ^ 

oA termifnal user can select any one of the programs at any time, 
and be given near-instant access to the complete program, regardless of 
the number of other users already using the program. This enables each 
user to haye complete control over his copy of the program. 
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Operation of the audio subsystem is based upon AMPliX ^igh-spee|| 
magnetic.! tape- duplicat^n processes. Each terminal ^has| at;i in(|ividual 
audio buffer control. Upon request of an audio pr^gi>airi t\!$ouj^h the . 
keyboard, the controller interprets the request so that; the sielected 



l:ed trkck'pn a 



7' 

this copy^^ 



audio program is duplicated at high speed from a selec 
master audio reproducer onto the user's buffer. Thereafter^ 
may be manipulated ahd controlled by the user into stop, s^art, rewind, 
fast-rewind, and fast forward opera^ons. Duplication speed of the 
program is 150 inches per second. T^e reels can holcj up to 25 minutes 
lof program play time. It will be possible to store a 
programs at ^ny one time during Phase I operation. 



\ 
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Audio-Video" Synchronisation 

Audio-video synchronization is accomplished by digital control 
codes imbedded in the audio programming; on play, the codes signal 

the controller to select and present the correspondi/ig video frames 

/ 

In Phase I the coded addres's will automatically synchronize the 
audio tape with the video images regardless of usqx^ manipulation of 
the program. Since these are absolute digital codfes, a user may. remind ' 
or advance his program and still maintain audio and video synchroni^t ic^n. 
Each program will be able to access a maximum of 128 pictures, which will 
be called-in -sequent ially as the^ audio is presented, 

.^ Audio Tape Preparation 

Programming control codeg has been made simple and convenient for j 
the developer of instructional materials through the use of the Mastering 
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and Loading Ceraer equipment. A portable AMPEX Model AG500 tape recorder 
is used to record expcf iment er-devo loped audio inputs onto 2-track source 

« 

tapes. As the priginal audio recording is pla/ed back, the operator enters 
a code and advances to the next code. The codes are released by the 
controller as a sor.ies of jrtvodu lated 35 hz bursts which represent a binary 
digital code. The 55 hz signal is recorded on the second track of the 
source tape. The source tape Is then placed on-line and ^^ts codea are 
merged as a subcarrier with the audio informatioh onto one of the 
eight tracks on a Master reproducer tape. The audio tape and video 
inputs may then be previewed at the Mastering and Loading Center on TV 
monitors. When a 55 \\z signal- fs encountered duri'ng the play, the 

% ■ 

controller senses an interrupt and presents the next picture, 

VIDEO SUBSYSTEM . * 

Video access is t^^ed upon storage of hundreds of iadividi^lly 
recorded video frames or images on the surface of a magnetic disk in the 
VM-lOO video masct^r disk unit, I'pon command, a movable head 'selects 
the requested imat;e from the master disk unit and the image is played 
back and' dupl icat ed on a fixed head buffering disk (video buffer 
disk unit) and reproduced on the student monitor as long as desired. 

Integrated multi-media system capability is available in that the 
same mt^nitors may bo used for alphanumeric presentations, live camera, * 
cable TV, broadcast material, and video tape presentation. 

Program material i§ .added to the master video storage disk using 
a video camera afid a character generator,,, The master. video disk has an 

4. 
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1 800 video frame capacjlty. Forty frames are used for test signals and 
indexing, and 1,760 are u§ed for instructional programming. The 
character generator, manufactured by Telematton Corporation, can combine 

witrt video inputs to form a composite of alphanumeric and pictorial . ^• 

I 

frames that can be transmitted to the station's video buffer and then 
to the user TV monitor. 

J ' - 

Video System Operation 

Theprograms developed by the experimenter can be audio, video, 
or a combination of both. Video-only programs are requested by 
the user in the manner similar, to the reqJest for .audio/video programs. 
Pictures within the video program are available tb the learner in sequence 
by pressing the "FIX Advance" or "PIX ReVerse" buttons. Each time a 
selected "PIX" button is depressed, the picture sequences are advanced, 
or reversed by one frame. By continuously stepping through the video 
disk using the "PIX Advance", the impression of tl^w motion may be 
obtained. 

STATION CONFIGURATION 

. Each of the Learning^Lab carrels in Version I 'consists, of an 
audio/video terminal with a responder keyboard. The terminal's video 
component is designed around the SONY 12-inch Trinitron color tele- 
vision receiver; the audio component is from the random access program 
material, routed to^ a head phone set at the,unit. -To communicate with 
tie system, each terminal has a portable 12-button access, control, and 
response keyboard. The keyboard resembles a touchtone t^lep>one panel 
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except^^at, in addition to numerals," video and audio control functions 
are also identified (see Figure 2). i? 

EXPERIMENT CONTROL 

In an experiment with instructional segments (i.e., pretest, training 
posttest, evaluation) where the segments to be administered require a 
decision, the experimenter will key in the identification of the next 
segment to be duplicated to his audio buffer. Segments will be played 
through to completion and the experimenter will control loops, skips, 
and-^xtended alternative paths (see TN 1-72-01 fpr definitions). 

PHASE II 

Phase II general design goals are: 

1. To provide random access video selection from any disk location. 
Thi^ijwill minimize the requirement to store duplicate copies 

f or s|i program using a picture more than once. 

2. To make available multi-program storage on audio master tape. 
Depending on the average length of an instructional segment, 
the audio master storage capacity will be significantly 
increased. ' 

3. To develop an Experimental Control Language (ECL) to allow 
lesaon developers to manage their programs more efficiently., ^ 
ECL will be translated into Experiment Control Codes (ECC) 

by a bfi^tch mode computer translator program. These codes 



will reside in core memory and operate in synchronization with 

79 
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4. .To expand iKe experiment control functions through newly defined 

EC codes. This is to include variable pacing, auHto buffer 
control, etc. 

5. To permit utilization of full al^Jhanumer ic keyboards at user 
I ^ stations . 

6. To );provide an automatic segment sequence control. This featute 
will allow the lesson developer to place an experimapt control 

^ code in his instructional segment (or following it) to Initiate 
the transfer of the next instructional segment to the u^er 
buffer automatically. This will automate interlesson branching 
and significantly redu'ce the oversell lesson throughput time. 
The elimination of the ^requirement to manually key-in succeeding 
segments will also reduce keyboard input error^. 

Even though most of the above items >are computer software ratHer 
"than hardware functions , another 8K core module must be added to the NOVA 
1200 to pemtit programming of the functions. ; 

PHASE III 

By Phase III it i^ expected that Lab researchers will have had the 
necessary hands-on experience to contribute suggestions for making IDCMS 
easier to use and mor^ appropriate to their needSi Toward this end, 

r 

the following design objectives' are planned: 

1. The experimenter will be provided with an on-line interactive 
capability to permit him to manage his instructional sequences 
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even though others are using tbe hardware. Included will be- an 
• & 

interactive progxam management ^ capability which will allow 

him to: . ^ ^ ' 

a- enter a new ECL source program 

b. edit programs to resequence the EC instruction set 

c. save or delete program files 



' * d. execute programs . 

Any combination of these operations^ c^n be performed at any 
station even though users at otjier stations may be performing 
other operations. In many respects IDQMS wiU resemble a 
' ' ' .mini-timesharing system, except that computer program develop- 
ment and system utility operations will need to be^ separately^ 

scheduled . ^ » «^ . 

2. The implementation pf '''arithmetic operators" will provide a 

particularly powerfuf tool for the experiment designer. "^JjP^ 
operators will provide loop coqnt control, student path tracing a 
through a* program, group path tracing, counter based automatic 
call-in. of new program segments i computerized dpci^slon^^king) , 
and so forth. ^ ' ^ 

3 Intra-audio buffer brancfartg will be explored during/this phase. ^ 
The development, of this capability will allow the computer to 
control audio b'uffer fast forward, reverse, etc. m a measured 
way. , \ ■ " - ■ 

^Phase III enhancements to IDcImS capability will involve a combin- 
ation of hardware' modifica^on, additional core memory, and skillful 



.computer programming. 
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PHASE IV 

The NOVA 1200 controller l^acks the ability to perforin complex on- 
line, real-t i^eN^palyses of us^r response data pr imar i ly-because it hSs 



1 



r 



insufficient Varo'city to accomplish analyses and sy/Stem/i^ont^ol simul,; 



taneously, A Pha^ IV design objeative is therefore to extend IDCMS 
capability to the po\nt where it can provide the e^tper imenter with 



computational powt§r be\ond the limits of the NOVA 1200 mini-computer. 

To accompl lsjtf»is , ^n o\-line interface with either a large time-shared,- 

or. a remote/batch computer will be developed. This will allow the raw 

^ ^^^^^ \ ' 

data of an expernaent tt> be rtansmitted via vtelephone lines feo the 



larger computer for detailed analysis. Once the data are processed, the 
reports generated, and the data bases are updated, the results will be 
transmitted bac|c to the NOVA to be printed or j^sed^as criteria for 
computerized deci>siofi making. ^ ^ 



ADD IT ZONAL IDCMS POTENTIAL ^ 

A potentially exciting aspect of 'the IDCKS developmental effort 

is in the area ot input/output devices to broaden the range pf. response 

and feedback ntiechanisms . In TN 1-72-02, Follettie def'bcribes a variety 

t . . 

of educationally useful response categories ^^that can present a high order 
of flexibility^ for researphers. The use of speech compar»ators aocl 
analyzers, &or exafhple, are devices that offer great promise in the 



field of voicB, input/ou,tput . Tifed to the ^Language Analysis Package and 

Music Analysis Package being developed at SWRL, computerized speech and 

{ ■ ' . . . 

music response evaluation may be investigated. , • , 
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The concept of IDCMS is unique. Its development will be affected 
by Laboratory priorities and by technological advancements internal and 
external to SWRL. Full exploitation of IDCMS potential will require 
both resourcejful computer system developers and imaginative and 
purposeful users. 



1 
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WorklriR Paper 5 

PROGRAMMING SPECIFICATIONS FOR IDCMS, PHASE I (TN 2-73-10) 

James M. Moloney 

* • 

This document present^ specifications for programs to be imple- 
mented for Phase I of lOCMS . The pj;ograms are categorized under the 
tol lowing^ four headings; 

i r 

1. Systems Programs / 

' * ■ / • 

II. User Programs x 

111. Utility Programs 
LV. Diagnostic .Programs ^ 

Systems prograjas are embellishments of the Data General Disk 
(h2^Lin;rSy3tem (DOS) architecture. They handle task priorities, 
osuJ)>li'sh job q.ueu^^, handle interrupts and 'other/system management 

t u:ic Lions ... 

UstT programs are designed to perform a. specific task for the 
"tvpi'.al 'user. • They may provide him with certain kinds of information 
[)F.Ki'Srfiii>; and/or an expanded capability. « 

rtility programs provide a generalized data processing function, 
llu-. Uicilitate day-to-day computer operation. They are not part of 
le DOS architecture and, hence, do not require a system generation 

\ . - ' 

fo\ their implementation. 

Diagnostic programs serve two functions. One function is 

provW an analysis of particular ins^tances of computer g|^unction 

that vill^ lead to an identification of the cause of the trouble. 

The second function is to provide statistics on different aspects of 



ft 



system performance that itidicate those p^rts of the system architectyre 
in need of improvement. , *" - v 

This document is intended to describe the necessary software ' 
modification for Phase I of IDCMS ; TN 5-7^-50 is a minimal pre- 
requisite for understanding these modifications. 



I. Systems Programs 



1. Delete "delayed" state code 

2. Constant time base 

3. Keyboard software 

II. User Programs 

1. Response recording 

2. Report generation 

3. Character generator software 

Itl. .Utility Program 

1. Copy /Compare Fi^eg^A 
IV. Diagnostic Programs 



1. System raonitOy 

2. System log 



I . System Programs 




1. The Anipe}<j supplied software contains code Intended for 
their Pyramid system. Some, of this- code is not necessary 
for IDCMS operation. It includes ^he "d^elayed" state code, 
and routines which are functional duplicates of routines 

(e^g., logical OR, ring buffering, etc.). Unneces- 
sary "S^je of this type will be deleted before incorporating 
IDCMS 

2. Several i?bi 
rangirlg from 




presently measure time using time bases, 
to .001 sec increments. Such multiple 



bases are justified for Ampex PYRAMID systems configured 
differently from IDCMS. In addition, it is necessary that all 
IDCMS routines operate on one fixed time base because response 
latency measurement will be required, thus, all IDCMS routines 
will be modified to run on a time ba'Se of .001 second. 



Under current IDCMS software, the^ 12-button keyboard (see 
figure l)^ay only be used to call up instructional segmetits 
and to in^pLate control functions. In Phase I, however, it 
will be necessary, that tke keys sometimes represent numerical 
responses rather than control functions. Thus, to the user, 
the system will appear to be in one of the three following 
modes of operation: (1) executive mode during which an 
instructional segment' may be , initialized and run; (2) function 

mode during which the keys provide control functions; and (3) 

f - - 

response mode during which the keys represent numerical 
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1. PLAY - Play audio tape. 

2. REC - If in "function" mode and tape is playing or stopped, 

change to "response'* mode. The keyboard light will 
be illuminated when in "response" mode. 

3. REV - Reverse audio tape at low speed.,. 

4. F.FD - Fast forward for audio tape, 

5. STOP - Stop audio^ tape. 

6. F.RV -Bast reverse for audio tape. 

PIX4' - IF AUDIO TAPE IS STOPPED, causes previous picture in 
sequence to be displayed. Otherwise, it will stop 
tape and then change picture. 

r 

'i 

8. CALL - Causes the console teletype in the Computation Cent&x 

to ring its bell and to print, the student station 
number. CALL has no control function. 

9. PIXt - IF AUDIO TAPE IS STOPPED, causes next picture in 

sequence tfo be displayect. Otherwise, it will stop 
tape and then change picture. 

CLR - If in "function" mode, nonfunctional. 

If in "response" mode, change to "control" mode. 

0.* - No control function. 

//. TRAN - If in "function" mode, terminates session. If in 
& "response" mode, acts as a robot. 
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responses. The followirtg paragraphs specify the changes to be 
made in the keyboard software. Any key not specifically mentioned 
for functi^ mode, retains its original function. 

In "executive mode, the TRAN key (//) will dlways signify that a*" 
user is waiting to log onto the system. To log on the TRAN will 
be followed •"by an experiment number nnni^n, and CLR. The ex-^ 
periment number will uniquely specify one instructional segment. 
This procedure will cause th§ system to start duplication of Vthe 
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master tape into the station buffer. At the same time the system 
will accept a user number, nnnnn. The user number will cpnsist 
of the user's CRC (1st 3 digits), plus two digits which 'identify 
thfe student/user. 

This user number will be terminated by a CLR and, when the tape 
has been duplicated, the instructional ^segment will begin in 
function mode. At any point in the log on procedure before the 
tape has begun playing, the user may start over by pressing IRAN. 
Likewise, as soon as the user number is terminated, thef,^ system 
is effectively in function mode, and the corresponding function 
of pny key pressed will be carried out a/s soon as possible. 
^Upon entry into function mode, the tape will be in' the STOP state 

The functions of five keys are to be changed for function Qiotl^. 
fhe REC key will change the mode to response mode if the audio 
tape is playing or stopped. The PIX+ and PIXt will 'stop the 
tape if it is moving and then change^he video frame backwar^ 

OS I 

(PIX+) or forward (PIXt). The CLR key will have no function 
and the TRAN key will return the\ser\to executive mode and 
a lo^on will be expected by the IDCMS monitor. 

\ ^ 

Tn response mode, all keys except CLR are tis) be considered 
as responses.' The CLR key will change thet mode to function 
mode. |The TRAN key^ill^e us^d as ^ single cftrfracter rub-out. 
For example^ if 1234/^/^56 is typed, then ^the 3 and^A are con- 
sidered to be rubbed out and the response is taken tb be 1256. 

-.9 



Note that in this mode the TRAU key will not return the user 



to executive mode. 

ft ' ■■ • 

'II .'^ User Programs 

There are three user programs to be specified for Phas0 I. Fir^t 
,a data recording* capability will, be added. The second program, a rp- 
^ port g^eneration program written in Fortran, will provide the user with 
A complete subject protocol for any subject run on IDCM?. The third 
program will provide the initial software for an expanded character 
generator capability in the later phases. 

1. The general data recording procedure will be as follows. 

£ach unit of data will consist of >four sixteen-^bit words. \ 
At certain specified time's vhieh will be precisely defined 
below, a data record will be written into a buffer in core. 

When 'full, the contents of the buffer will be transferred to 

/ ^ 

the disk and finally to 'a seven- track magnetic tape. 



4 bits 



The data record will h^e $:he following format : 

28 bits 8 bits 8 bits J.6 bits 



' . STA 



TIME 



PCORD 


DATA 


TYPE. 






^ — 



DATE 



4- 



The station number (STA NO.) is a 'four-bit binary nui^^er, 
^betw^en one and -six. It wilKserve'to identify Vhe record f^r 

^ . '-^^ ^, 

later\processipg. ' . ^/ / » , 

The time is< a 28-bit byte- c^ontadping tHe elapsed time 
measured from midnight , each da^ - ' ^ 
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The recotd type is an 8-bit binary number which identifies 
thfe type data that the record contains. "Xhere are presently 
only the following five record types defined: 

16 - Picture code 

17 - Time of display 
32 - Keyboard .stroke 

3? - Header infbnnajiion 
48 System message 

Multiples of 16 were chosen for the primary record type iden- 
tifiers to- allow for two levels of associati-ve information for 
-''future classification and analysis. For example, the 8-bit 
binary code For a picture code. is 0001 OOOO2. A record 
will be written using this .code each time a picture ciode is 
encountered; It is also useful and interesting tb know when 



th§ picture w'as actually displayed on the screen since there 
is a delay between encountering the picture code and displaying 

i 

the picture, The time of display (TOD) code is defined as 
0001 OOOI2 (I^-lq). Then a TOD record isf written giv^n the 
exact time "a picture'is displayed. „ 

The next 8 bits of the record contain the data. There will 
be as many data types as there are record types. The data for 
a picture code (16) will be the binary picture number. Since a 
TOD code (17) will always follow a picture code, the data field 
"for a TOD may be null. The data for keyboard stroke (32) will be 
' an ASCII character representing the key pressed. For digits, this 
is straightforward. For tK« functions^ unique encodings mifet be 
specified. When assigning these codes, the conversio^to full- 



alphanumeric keyboards should be kept in mind. The header infor- 
mation (33) will be th^ same as type 32. The change in record 
type is to allow the report generation program to more ^asily 
recognize sign-on information. The data for a system message 
(48) will be the binary message number. ^ ' 

The final 16 bits of the record will contain the date.- The 
date will be a binary number representing the day, month and 
year. Day zero will be January 1, 1900. 



During Phase I, the DOS magnetic tape softw^ire will be used. 

» 

The DOS User^s Manual .makes the following statement about 7- track 

tape units . * ^ . . 

Data recorded on 7-tirack units is necessarily encoded. " 
This is accomplished in the following manner; . 



Original , — , . ; > 

Dat^ Word I Olll2|3|4l5|6|7|8|9llO|ll|l2|l3ll4rin 



E^ncoded 
Data Words 



X 


X 


X 


X 


0 


1 


2 


3 


X 


X 


7 


X 


4 


5 


6 


7 


X 


X 


X 


X 


8 


9 


10 


11 


X 


1^ 


X 


X 


12 


13 


14 


15 



V 



Every data word written on a 7-track unit as two encoded 
data words. When actually written. oisi the tape the data will 
look as follows: " 



X 


X 


0 


1 


2 


3 


X ] 


X 


4 


5 


6 


7 


X 


X 


8 


9 


ID 


,11 


X 


X 


12 


13 


14 


15 



The report generation program will accept as input the response 
data tape described -above. Figur^ 2 shows each type of record 
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-f 

ST A 
NO. ■ 




TIME 


OF DA'Y 




0001 OOOO2 


BINARY 
' ^ NO. , 


DATE 








a /) Picture 


code 


record 

<r 






— . 

N(i\ I 

. 1 


(T-. - 


TIME 


OF DAY 




0001 00012 


BINARY 
NO. 


DATE 



STA 
NO . 



b.) Time of display record 



TIMZ.OF DAY 



0010 OOOOc 



ASCII 
CHAR. 



c.) Keyboard stroke record^ 



DATE^^ 



V 



STA = 
NO. 


• 

TIME 


OF DAY 


0010 OOOI2 


ASCII 
CHAR. 


^ DATE 

■ 




d.) Header information record 


STA 
NO . 


TIME 

1 


OF DAY 
/ 


0011 00002 

^ V 


BINARY 
NO. - 


DATE 






e.) System^ message 


record . 







Figurie 2, 
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S AMPLE FORMAT 



DATE 
MM/DD/YR 



(START. TIME) , 
HH:MM(1) 



EXP:DDDDD USERrDDDDD " STA:D^ 

************ * 



EVENT 

KEY 

PIC 

TOD " 

KEY 

KEY 

KEY 

PIC 

TOD' 

KEY 

KEY 



TIME DATA , 

3,:.30:04.713 REG (2) 
3^30:05.002 ' 1 \ ' 
b:3a:06.999 (3) 

3:30:07.454 3 

3:30:07.678 4 

3:30:07.890 5 \ 

3:30:10.225 2 
3:30:11.019 

3:30:14.329 6 

3:30:14.489 1 



LATENCY 



2.452 (4) 

0.224 

0.212 



4'. 104 
0 . 160 



SYS 



3:33:46.321 



MIO (5) 



PIC 
TOD 
KEY 

"--k£y 

KEY 
KEY 
KEY 
KEY 
PIC 
TOD 
KEY 
KEY 



3:40:34.747 
3:40:35.123 
3':40:40.333 
3:4(P:41.586 
3:40:41.937 
3:40:4lVi23 
3:40:42.456 
3:40:42.678 
3:40:45.345 
3:40:47.890 
3:40:49.567 
3:40:49.999 



17 
0 

CLR (6) 
F.FD. 

STOP 
PLAY 
REC 
21 

8 

3' 



5.586 



4.222 
0.432 



* * * END OF EXPERIMENT DDDDD * * * 
yHO: poor PICTURE QUALITY 
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that the program must handle/ It will provide as output a 
report similar in form to Figure 3, except for the parenthesized 
expressions which are used solely for descriptive purposes in 
this document, ^ Latency will be computed for response mode data 
only . 

The header information (1) is obtained from a string of records 
of type 33 (Figure 2,d). The first record ^S^ill contain a TRAN 
in the data field anjfi the start time, date and station number 
Vre obtained from this record. The encountering of a TRAN for 
any station will, always signify a new sign-on and the generation 
of a new report. The TRAN is followed by. a sequence* of type- 
33 records containing ASCIJ digi^ in the data field followed 
by a , type 33 record with CLR in the data field. The experiment 
identification number is the concatenation of the ASCII digits. 

The CLR is followed by another sequence of type 33 records 
containing ASCII digits and terminated by another CLR, These 
digits are the user number. No further type 33 records will 

be found . ^"^"^ 
' . f 

In the eveV-that a type 33 record containing ^ TRAil is . 
followed^y the one* or more TRAN recc^ds, the last, ^uch 
record is to be u^d for " the .header i^formatio^. A sfi^gle 
isolated type 33 recoj^d with a TRAN in the data field is' 
ignored. - 



The first ^vent on the sample' report (2) indicated that the 
user requested response mode at 4.713 sec after sign-on (assuming 
that sign-on was at 3t30). The inforroation was obtained from 
a type. 32 record with the ASCII representation or REC in the 
data fi^ld. The time is the value o^f the time of day field for 
this record. * >^ 

The next event (3) shows the time that a picture was actually 

4,isplayed. This information always follows a picture code and 

is contained in a type 33- record. 
."^ 

The next even^ (4) is the occurrence of a picture code (PIC) at 
5.0002 after sign-on (assuming start time is 3:30:0.000). The 
information was Obtained from^ a type- 16 record with the picture 
number stored in the data field in bina^ry. A picture code 
sometimes, indicates that a keyboard response is expected. In 

such cases, the above-mentionec^ type 17 record will be followed 
by a sequence of one or _lBore typ.e 32 records containing ASCII 
digits in their data field. These recprds provide the informa- 
tion for printing the three lii|es 'following (4). The latency to 
first response (in i?i3ec) is obtained b^^"^subtracting the time 
of the start !of the immediately preceding TOD, The latency to 
each additional keystroke is computed by subtracting the time 
of the keystroke from the time of its immediate predecessor. 
If .a type 17 record is followed by anything but a type; 32 with 
ASCII digits in> fts data field, then only the event, time and 
data information must be printed (6>. ^ 
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PICTURE DISPLAY TIME REPORT 





EXPER 


PIC 


« iiVJw uxor ^ 






NO.- 


CODE 


TIME 
















1 


1 


447 






1 


2 


798' ■ 






1 


3 


1096 






1 
• 


4 

# 


582 






• 

1 


• 

17 


• 
• 

693 






2 


1 

• 


. / 891 








• 

121 


924 














• 


OVERALL 


MEAN DISPLAY TIME « 


777 millisec. 







Figure 4. 
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Occasionally, type 48' records will be encountered. These will 

w 

give rise to entries such as (5) in figure 3. The error 
message will be decoded at: the bottom of the page "as shown. 

It is imperative that the program be written in a highly 
modular fashion since it is likely that* new record types may 
be^^^ded and other report formats may be requested. For 
example, suppose it is desirable to obtain data on the delay 
in actually displaying a picture after a picture code ie en- 
countered. A report generated for this purpose, using informa- 
tion contained in a type 17 (TOD) record, might be of the form 
shown in Figure 3. 

The ASCII codes for the control functions and the special 
characters will be provided by the^ systems programmer. A table 
of system messages will also be developed. ^ 

The third user progran^ involves designing a disk stored 
"message*' file for input to the- character generator and 
developing the routines necessary to associate the message, 
with related program video images. In addition, character 
generator software will be expanded to aHlow input to the disk 
message file from the keyboard. Investigation will continue 



on.softx^are 'implgmentat ion of such character generator 
functions as centering on the page, snake up, ^snake down, etc. 

The disk storage of messages for input to the character 
generator should be designed po conserve disk space as much 
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as possible. A storage scheme developed by Porch and Ambler 
will be outlined here. This scheme is one of many that may 
be employed for message storage. 

There will be the following storage components: 

(1) A message directory with pointers to the first word of 
each successive message stored in the main storage area. 

(2) The main storage area contains messages . 

(3) Messages are made up of elements followed by a message 
terminator. 

(4) An element is a string of ASCII characters or a call 
to another message. 

(5) .A call, consists of a special function character foUowec 
by a message number. 

The following example is not intended to specify the exact 
internal storage technique / but merely to serve as an illus- 
tration. Note the small expansion in storage needed to save 

inpv|t message No, '2. ' ^ 

I 

i 

EXAMPLE i , ■ 

Input Message No. 1: ^ 
- THIS MESSAGE SHOWS THE MESSAGE STORAGE METHOD 

Storage Illustration: 

1. THIS (2) SHOWS (3) 

2. MESSAGE 

.3. T^ (2) (4) METHOD 
• 4. STORAGE 
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^ Input Message No. 2: 

THE MESSAGE STORAGE METHOD SAVES STORAGE SPACE 
Additional Storage : 

5. (3) SAVES\(4) SPACE 

Calls \o messages will allow significant reduction in disk 
storage requirements since each element need only be stored 
once, regardless of the number of messages in which it is in- 
cluded. It is possible tHat the ECL source code may be stored 
in ^an analogous manner for Phase II. - 

III. Otility Programs 

The programs described iiJ; this section are of general use to 
system operator and prograiraners in the daily operation of the system. 
They will provide several necessary information processing functions. 
Although they will seldom, if ever, be used by the general user, they 
are not systems programs and will not change the overall system 
architecture. 

The utility program discussed here is a magnetic file copy and/or 
compare program. This program will perform three separate functions. 
It will be able to move data from one specified file to another. It 
will be able to compare data from one specified file with another. ^ 

During the comparison, the program will provide detailec error messages 

/ 

if necessary, and then continue until eiiid.of tape or file. 

\ 

. / ■ lOO" . . 

/ 
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TV. Diagnostic Programs 

The major diagnostic i-mplementation method will be the use of the 
conditional assembly feature of the NOVA assembler. By "using this 
facUity, it -will be possible to insert debugging code throughout the 
system but not assemble this code under normal operating conditions. 
The special code may be activated when necessary by a simple one-step 
re-assembly. ' 

- 1. There will be a routine to monitor and evaluate system timing 

J - 

conditions. This routine will use the starting address of the 
interrupt service, routine as an access point. For each interrupt 
(including the clock) a counter appropriate to the interrupting 
device is incremented, then control ibreturned to the system. 

" Two types of critical timing information will bg made available 
■ from utilization of this routine: (1) How many different types 

of interrupts occur per unit time. (2) How critical is the' 
• latency between the interrupt for each device and its handling ^ 
response . . 

The first type of information may be obtained by monitoring . 
system interrupts with the routine for N seconds. The second 
type of information may be obtained by causing successively • 
greater delays before handing process control back to th^ 
system. When the system stops acknowledging interrupts, the 
critical timing latency has been reached for that device. 
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2. A routine will be written to keep 'a simple log of the day's 

events. This log will be kept-^s a disk file. Such a routine 

will provide information on utilization, system load, sequence 

of significant events, etc., when problems occur and, thus, 

aid in the analysis of these problems. Information included 

in the Phase I log will be such things as: 

Time: Terminal N is starting lesson M ^ 

Time: Terminal N is down 

Time:, System crash 

Time: Magnetic tape write error , 



/ r:'- J etc. 
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•CONTINGENT INSTRUCTIONAL ADVANCE: IMEL^TIONS FOR IDCMS (TN 

k^seph F; FoUettie > 

Student-system interactive instruction or research requires decisions 
to idvance S or to loop off the mainline contingent upon some or all of 
the information reflected in prior performance. The SWRL Instructional 
Development Control and Mpnitori-ng System (IDCMS) in time will .be 
appreciably used to establish characteristics of effective-efficient 
i-nteractive instruction. The design of IDCMS in Version 1 hardware 
eonf iRuration nc^w is appreciably completed. The design was premised on 
a Keaeral view concerning what the system will be asked to do and cost 
considerations. Developing views on how the system in Version 1 form 
Jesir.iblv will be used now make enter tainable the proposition that slight 
modifications in hardware design may be warranted. Althougk perhaps a 
less Imperative natter, parallel comments seem applicable to software to 
he -provided by the contractor. The particular slight modifications in 
th'e contracted svstem that may be warranted can only be identified and 
evaluated ip consequence of increasing specificity regarding desired 
■general svstem functions. - Among system functions, the interactive one 
-presently invites' clqsest'scrufiny;. many research functions are subsumed 
bv the system's interactive function. The scenario to be|presented 
illustrates an interactive structure in sufficient detail to permit 
qualified staff to evaluate the contracted IDCMS configuration against , 
functions inherent in the interactive structure. Such an approach is 
only as viseful. as its illustrative argument is compelling. Hence, the 
possible executive decisions that system "deficiencies," s6 defined, 
invite ire- a) If costs are acceptable, modify contracted design for 
the system to achieve illustrative functions. b) Modify the interactive 
requirement to correspond to the contracted system. A compromise, dec ision 
tailing between' these alternatives also is possible. 

• A mainline instructional program' is one that S will negotiate to a 
program-defined exit if the instruction^il control decision at each 
decision point falling along the mainline is positive (+) . That is, xf 
at e^ch point tested S reveals a criterion level of proficiency for the 
program skill(s) (PS) tested, then he will advance along the mainline to 
a predetermined succeeding lesson until^ at last, he exits through a 
terminal decision point for the program. However, whenever his per- 
formance warrants a negative (-) instructional control decision, S will 
loop off of Ehe mainline. That is, S will loop off o^f the mainline 
v;;h¥7ever a test reveals achieve-ment of less than a criterion level of 
proficiency for test,ed program skill(s) . 

If a test warrants a negative instructional control dec is ioy — tha t 
is reveals subcriterion prof ic iency— then two major causes for this 
decision can be discerned: a) prior relevant mainline instruction or ^ 
the conditions of its administration— e.g . , pacing— are ineffective 
for this particular S or b) prerequisite skills not taught on the 
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mainline are deficient. Cwo sorts of prerequisite skills — distinguished 
on the basis of the point in the instructional progre^ion wherein their 
proficient employment is required — can be discerned: a) entry skills 
(ES), whose proficient employment is required during earliest lessons of 
the instructional program and*) enroute prerequisite skills (MS)', whose 
proficient employment is required at later intermediate points in the 
instructional sequence. Th«i^ point at which such skills become relevant 
would not be particu-larly important as a basis for distinguishing thre * 
two sorts of prerequisite skills if skills of both sorts became relevant 
one at a time. However, it tends to be true' that several prerequisite 
skills become relevant at the outset of instruction, whereas prerequisite 
skills that b ecome relevant later in instri^ction do so one at*a time.; 
Illustrative interactive instruction initially will make use of this 
difference in temporal concentration of entry a^id enroute prerequisite' 
skiLls. However, later remarks will place ES and MS in the same set 
(EMS). " . . 

A fundamental assumption underlying the structure to be illustrated" 
is that student-system interaction should reference to moderately exten- 
•sive instruction und^r the condition of multiple usership (e.g., 6 Ss) 
S'ome of the problems we, will encounter disappear or are considerably 
lessened if instructional extent is taken as one-third of what we will, 
show. When elsewhere we examine t ime^pressui^ed retrieval-transmission 
from stores containing much larger numbers of "entities," such a lessening 
of extent will bound the effoxt. 

Moderately extensive instruction is here ndrmatively defined a"^ 
15 30-minute lessons, such that an S who^e rate of acquisition (referenced 
to the illustrative instruction) is average will complete the program by 
working 25 minutes per day on normative instruction and" supplement ing 
ins truce ic^ as needed. Figure 1 provides a diagrammatic view of the 
^ illustrative instruction. Open circles reflect mainline instruction; \ 
closed circles, the (identified) prerequisite skills, (A foreseeable 
outcome of interactive research is that' it will invite +H hypotheses 
concerning relevance of formerly identified prerequisite skills.) 

Level 1 lessons of Figure 1 may be interpreted either as addressing 
single program skills without subordinate skills structur^e or as addressing 
aerogram skill- that is superordinate to a set of subskills. The former 
view yields the simples^t. pipssible illustrative program. Since the program 
already has been exten^veiy o''versimplif ied, the second interpretation 
is used here's We characterize Level 1 le'SSon/s of Figure 1 as reflecting 
a program skill t-hat integrates twk^subski J:3:^ previously taught in the 
same lesson 



\ -^Particularly where rule leajrning and generalization are required- 
as in phonics instruction — Figure 1 dramatically oversimplifies the 
sit-uation by failing to reflect buildup of the rule set over lessons* 




104 



-105- 



ERiC 




o 

CO 

w 



o 
u 

CO 
CO 

o 
cn 



r 1 







o 








4J 




(d 




M 




bO 




0) 




4-1 




In 




,, 
11 
























4-1 




CJ 




:3 




u 




4-J 




CO 




(U 




> 








4J 








M 




bO 




Q) 




4-1 










• 




CO 


1 


iH 




iH 


to 


♦H 


iH 




iH 


CO 


•H 






0) 


CO 


4-1 




•H 




CO 




•H 


u 






O* 




0) 


:3 




CJ* 


0) 


d) 




CO 




&o 


0) 




4-1 


•H. 




J? 


o 


O 






C3 


CO 






^3 


p 












&0 




O 


/— \ 




CO 


PU 


^— / 


•C 




. O 


CO 


CO 


tH 


CO 


iH 


0) 


•H 


>-l 


*M 


1 


CO 


in 




iH 




0) 


4J 


> 


d 


•H 








nl 




M 




4-1 


CO 


CO 


iH 




iH 


iH 


•H 




M 


CO 








O 



„ 105 ^ 



0) 



•106- 



Entry Skills (ES) 




Any instructional program is predicated on one or more entry ^kills, 
These skills are 'required during earliest lessons of the ins^ructl/onal^ 
program. However, they are tayght only if .evaluation reveals thaj! 
performs below criterion proficiency level fof them.\ It is_typic/al t^ 
class as entry skills only those skills for which it can be^assumed that^ 
at least halfof the entering Ss will be criterion proficient wh/en tested 
^t the out^lrts^f instruction, Eai::^li.est lessons of giv^n instruction 
typically wil^^f^guire S to be criterion proficient in Wveral such 
skills. Because sa;?i^ny entry skills require evaJuatioi\ at?Obhe outset 
of i^jstruction, We as^^e that an initial test, consi.stiA^ of \ per- 
functory subtest for ea^^ntry skill, will either clear for initial 
instruction or will yield o^^^r more hypotheses to th^ effect ^that E 
may be deficient in one or mo^^ntry skills. Should S bq '^^leared for 
mainline, instruction (+ES) , tenab^^ty of one or more hVpotheses o£ form 
H:-ESi still might be established l^^^in consequence of diagnostic 
characteristics of the evaluation sys tlSb^Should a hypothesis H:-ESi be 
entertained in consequence of adminis^^elngN^h^ perfunctory entry skills 
test, then deficiency in ES^^ might be furthere^luatedj using a more 
extensive test EV-j^-ES^ (see Figure 2) . 

.We assume that skills analysis referencing to gi>^ instruction 
should be extended downward no further than one leve>J.^elow the level 
of the entry skill. In consequence, if H:-ES^ is found te,nal^e, then 
one level of fo rmal instruction culminating at the ESj^ level of a pro-|^ 
ficiency hierarchy can be designed. We denote such instruction IN-ESj^. 
Effectiveness of such instruction can be tested using a second versicfn 
of the test for criterion proficiency in ES^^ — denoted EV2-ESi. * Sho^d 
this test also reveal tenability of H:-ESj^, then one's options would 
be either to administer versions of IN-ES^ and EV-ES^^ as required to 
raise S to ESi or to administer informal Instruction and Conduct in- 
formal evaluation culminating in the decisibn +ES^ . We show the second 
of these options in Figure 2. Which optibn would prove most .apt probably 
will depend on the particular characteristics of ESj^ and, in researcli 
setting, of E and of the system that supports student-system interaction. 



Where this is allowed, various system-burMnlng requirements emerge. 
First, the system must store a rather large number of novel rule words 
that permit testing for rule mastery in all appllcalDle intraword positions 
and in all applicable word contexts. Second, so many alternate diagnostic 
tests can be imagined that on-line composition of tests becomes required, 
which may entail complex coding of word items. Were we to admit this > 
complication into the illustration, th^n the lengthy paper that llfes 
beyond would not -be required. The system simply could not handle 
extensive rule learning and generalization within the context of moder- 
ately extensive instruction* - \ * 
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Illustrative Flowchart for .Entry Skills (ES) And, An ith Entry Skill (ES^) 
In Particular For'l^fch S Is Unacceptably . Prof icient , Treated Interactively. 
H = Hypothesis, EV = Evaluation, IN = Instruction, Minus Sign = Unacceptable 
Proficiency Level, Plus Sign = Criterion Proficiency 
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Enroute Prerequisite Skills (MS) 

« 

, Enroute prerequisite sk*llg differ from entry skills only with re- 
gard to the point in ihstruct;ion wherein they become germane. vThesg 
skills — denoted MS — become prerequisite to instruction at intermediate 
points during instruction, rather than ^ring earliest lessons. Typicall] 
such prerequisite skills will become germane one at a time. That is, 
unlike entry skills — several of which will prov^ germane at or very 
-nearly at the outset of instructiont-eniroute prerequisite skills will 
warrant consideration singly at different, points in instruction. In 
consequence, it is not necessary to employ an overall perfunctory test — 
EV-MS— for these skills. Rath'er, at the point wherein a given such 
skill MS^ becomes germane, a definitive test EVj^-MSj^ may be administered 
(see Figure 3). Again, one's options are a series of version's' of IN-MS^ 
and EV-MSj^ which formally instruct and evaluate until the conditipn 
+MSj^ is reached or informal instruction and . evaluation culminating in 
^MSi after preliminary formal instruction and evaluation. Again, we 
shciw the second option in the flowchart. 

As with entry skills, categorization of S as +MSi need not be 
irrevocable. If later evaluation Is made 3-uitably diagnostic* then it 
remains possible at some later point in instruction again to entertain 
H:-MS4. 

Program Skills (PS) . 

The instructional design-development ef f ork^assumes that not all 
Ss^ will require administration of instruction addressing ES and MSj^ 
however, it ^is assumed that, all Rs will require administrat^ion of every 
program skill. ^ 

Figure 4 — an oversimplification to be corrected in later remarks — 
begins with first instruction for some progtam skill PSj^ falling on 
the mainline; this instruction is denoted IN^-PSj^. The illustration 
assumes entertainability of three hypotheses: a) HO:+P.S^, b) Hir-PSj^ 
with caus^ -MSj^, c) H2:-PSj^ with cause ineffective INj^-PSj^ (ineffective- 
ness defined on S) . In consequence of S's EVj^-PSy performance, we eith^' 
will accept Hq — or, for the benefit of those who do not accept hypotheses, 
strongly entertain It — or will entertain or fl2. If H]^ or H2 exhausj:^ 
the possible causes of -PS^, then It is not necessary' that EV]^-PS^ 
provide a definitive basis for choosing between Ri and H2 (although 



^Should empirical effort reveal this a^^nption nqt to be tenabTe, 
then instructional redesign and redevelopment wo^ld^be required consonant 
with the proposition that all Ss will require administration of every 
pro,gram skill. ' ' 
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Figure 3. 
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Illustra^tive Flowchart For an ith. Enroute Prerequisite Skill (MS^) Treated 
"'Interactively. EV = Evaluation, IN = Instruction^ Minus Sign = Unacceptable/ 
Proficiency I^evel, Plus Sigri^ Criterion Prof iciejicy . ^ -^''^X 
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instruotlonal efficiom-v will be higher if the test is definitive re- 
>;nrding cause). Figure U h,iH us evaluate either H; if it is rejected, 
•the'n the other H Is taken as tenable and prescriptive instruction is 
administered accordingly. H H.2 is found tenable, then one alternative 
is to' treat PS, In greater Instructional depth (or to elaborate on It, 
to use alternate exemplars, to make its logic more explicit, etc.) An 
..xtended ser ies-IN.-PS j + V.V,-?S^ through IN^-PSj + F.VVPSi--migh t then 
b.- devised to take Instruction to whatever levQl of elaboration experience 
proves useful. Alternatively, at some point early in such a series, 
one 'night switch over to informal instruction and evaluation. While 
1 igure 4 terminates the prescriptive series that is consonant with 
accepting Ho on, formal instruction and evaluation. It often will be true 
that arr acquisition problem can only finally be overcome in consequence 
ot Informal intervention by K. Such an exit from prescriptive instruction 
is uncr-i.tical here because -it will not be counted in the count of program 
elements tiiat burdens the system. 



Closer look at " P rergquis Ite Skills 
• " : ; - J ■ e / . ■ ' 

T(he distinction between ES and MS probably can be defended on 
grounds of evaluative efficiency when instruction is extended. However, 
the present i 1 lu,s t fat ior probably will not suffer if we collapse the 
two—denoted collectively EMS. Let EMS ='8. We will assume that it 
rakes x;ense to- te^t any H, (that a prerequisite skill is deficient) 
asinv> a cursory screening test EV-EMS . If, as we will, we theH assume 
th^it is necessary to follow up on the evidence provided, usipg a. 
restricted test EV-EMS., we are assuming in effect that the dikgnosis 
hased on the cursory t^st may be -tfi error. I believe such an /outcome 
should^hrow S back to a^ second version of EV-EMS. Let us assume that 
the system stores four ^uch versions EV^-EMS throu^ EV^-EMS , These are 
stored as separate, randomly accessible segments because if Retrieved 
as a sequence we will need tell the system where in the sequence we 
wish it to trartsmit. " 



fiince EMS =8, we require 8 EV^-EMS^ and 8 EV2-EMSi 
of these constitute- one segment, then 18 such evaluative s 
be stored. Consonant with earlier remarks restrfctipg fo'- 
of defective prerequisite skills to one treatment, which w 
as two segments, storage of an additional 18. segments will 
The prerequisite skills 's torage , in .segments, th^n is 36 — 
EV-EMS i, and 16 IN -EMS i. 

If EV-EMS yields (or EV-H2 yields, not -H^) .then 

that'one of eight 4-segment sequencer's be retrieveS and pr 
to S be initiated. Such sequences have the form EV]^-EMSij 
IN-EMS.u + EVo-EMSi- While S may exit from the sequente (f 
or EVo if he does not exit at EV^, thfen he will/Continu 
'sequence in fixed order. Hence, .the illustrative instrudt 



.0tting eath 

s/gments must 

5tai instr^uction 
finterpret 
ie required. 
I EV-EMS, 16 



will be required 
jentation 

IN-EMS^ + ^ 
)llowing EV-j^ 
through the 
Lonal program 
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requires that four randomly accessible one-segment program elements and 
eight randomly accessijjle 4-segment program elements 'be stored for pur- 
poses of evaluating /^d instructing prerequisite sljiills.'^^ 

Segment Characteristics 

For present purposes, we will define segments on time ■ Let the 
segment consist of 2-20' items, where an item may be audio only, video 
conly, or audio + video as such characteristics can be discerned by ^n 
uncritical review of audio program and video frame storage for IDCMS . 
(We say uncritical b^ause number of storable audio programs may be at 
issue.) Let the segment two minutes long on the average, with number 
of items — 2, 20, or an intermediate number -determined by mean item 
duration. What will vary is duration of the audio message. We assume 
that every audio message space will be preceded by an 11-bit digital 
code whose average duration will be just in excess ofTT. 5 seconds and 
whose average separation from the audio message space — measured, from the 
end of the code to the beginning of the message space — will be 1 second. 
We assume farther that a ^top interval lying beyond the audio message 
space will use 1.5 seconds of tape. Thus, if the segment contains 20 « 
items, then an item will occupy 6 seconds of audio tape and the audio 
message space can only be 1.5 seconds long (because code, code separation, 
and stop intervals use 4.5 seconds). On the other hand, a 2-item segment 
on the average will feature 55 second audio messages. Wherever one 
instructfdnal sequence (without, testing interruption) features a series 
of instruct idnal segments, theh the instructional sequence, together 
with the test that terminates it, can be* stored as ^ sequenced program 
element. Program element stf^age for prerequisite skills ia fou9^ 2-minute 
program elements and eight 8-minute program elemei^,ts — or 12 elements,^ 72 
minutes » 



-H^/hile it is lik-ely that program elements referencing to higher- 
numbered prerequisite skills will not need be stored th|^oughout instruc- 
tion, a continuing requirement to store 12 elements presently appears 
sufficiently slight that it would not be worth the trouble to simulate 
the slightly lower requirement that wc5uld characterize a best day 
requirement for six Ss. Worst day would require that all elepents be 
stored. 

The system as contracted contemplates using 7~bit codes. Ttiese 
suffice to random access to 128-track filfes — which requires only four bits. 
If seven bits really are required just to do this> then perhaps we require 
14 bits rather than 11 to be able to get to any track number of video 
storage. .While we do not require random accessing to individual tracks 
for purposes of saving illustrative instruction,* the requirement will 
go beyond capability for accessing to th6 starting point of any of 
just. 16 128-track video files. Rather* we may need to be able to access 
to as many such files as we define program elements, 

\ 
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A Closer Look at Program Skills 

Foregoing remarks have dispensed with H^, Hq accepted, continues 
on the mainline, Hq rejected and rejected, H2 must be accepted 
(unless one hypothesizes some previously-unidentified prerequisite skill — 
the signal to start over). Just what H2 entails turns upOn lessOn level 
in the skills hierarchy (see Figure 1). Level 1 skills complexes are 
independent of other skills complexes!! If is rejected following 
rejection of Hq, then subcriterirmri^erformance detected by a Level 1 test 
limits the search for defective inst^-uction to that for the particu^lar 
lesson in which the Level 1 test occurs. Let us look at the Level 1 
mainline Co clarify where one can go in the -event that a Level 1 test 
detects subcriterion performance. 

We. have asserted that every Level 1 lesson. (Figure 1 shows nine) 
will feature' two ,subs-ki lis that are taught and then integrated. The 
integrated program skill then has the subscript of the lesson's number, 
Ejjch mainline' treatment of a Level 1 lesson then will feature three 
ir^-EV sequences. Fyr present purposes we assume that any such sequence 
consists of two instructional segments and one evaluative segment. 
Sequences, or program elements, for a Level 1 lesson are: 

1. INj-PSii3 + INi-PSfib +.EVi-PSii ' ' 

2- I|^l-PSi2a + INi-PSi2b + EVi-PSi2 " . •' ' 

3. INi-PSi3 + IN^-PSib + EV^-PS^ N ■ . 

Each sequence terminates ; on an EV which, detecting subcriterion 

performance, will jerk S off the mainline, Hencjfe, It makes sense to 

view Level 1 mainline storage as 9 (lessons) x 3 (Sequences) 3-segment 

program elements, or 27 6-minute program elements. 

o' If Hq and'H]^ are rejected in, consequence of a^^i^nistration of 
EV-PS^j^ or EV-PS^2' ^^^^ there seems just one ,pjlace ■ to go — to an 
alternative version of IN-PS^]^ or IN-PSi2 alternative version, 

wl>t^h alternative procedure — e.g., regarding pacing). Werevwe to ^follow 
Figure A literally, then we could overload any system at this point, 
simply by requiring many versions of each sequence. For present purposes, 
let us require jusrt one alternative version per mainline instructional 
sequence at Level 1. • 

If Hq and H^^ are rejecte-d in consequence of administration of 
EV-PS^, then the difficulty could reside at any of three addresses. 
Either instruction is ineffective for one of the two subskills or it 
is ineffective for integration of these sub3kills.. While this coulfl 
necessitate a longer-than~one-segment EVi-PS^, its follow-on implications' 
for alternative sequences need not differ from those for aubsWlls. 
That is, again we will require just one alternative version per mainline 
instructional sequence that integrates subskills at Level 1. However,, 



113 ■ y 



ERIC 



/ 



-114- 



if the difficulty is identified as being at the siibskill level and an * 
appropriate alternative sequence is ne:^tiated, tt^en we wouldn't wish 
to have S negotiate neW instruction at the integrajtive level just to be 
able to negotiate a new version of EV-^PSj^. Hencej let us require a 
single additional version of EV-PS^^, to be used ji^st to evaluate the 
program skill at the integrative level. In consecjueiicej Level 1 looping 
to alternative versions of mainline instruction will' require >(if we 
circumvent EV-H2 testing) 27 3-segment and nine l-segment program 
elements. ,This amounts to 2 7 6-minute.and nine 2^minute elements. 



Hq and Hj^ rejected at highei^^J^yels , the source of difficulty is a 
more co^lex matter. Lessons 3, fef and 14 of Figure 1 are at Level 2. 
As.^uming that higher-level instruction has only the structure Implied ' 
by Figure 1 — that is , higher-le"vel open circles embrace no structure of 
their own--being simply integrative with respect to the lower-level 
skills that they subsume — then a ifesson 3 or Lesson 6 failure on an 
appropriate test for skills^ integration may be due either to the failure 
of Level 2 instruction or- to Leveb^ 1 failure referencflng to either of 
two subsumed skills. Les^pn 14 fa^^lure, according to the same reasoning, 

ry bp due to fijve sources of failure.* Let us assume that mainline Level 
instiruction 'fi/11 c^rtt/ajyfn ;4S| ifiany^l6nstructional segments as the^e are 

.Ife. XHus, tK^lieyyfel/ 2 t 



subsumed Level t sk^i] 



titaiilUnq/ sequenced are: 



Lesson 3: 



1N1-PS33 



+ INi-PS 



31j 



EV1-PS3 



Lesson 6: 
Lesson 14 



IN, -PS 



6a 



EVi-PSg 
+ IN, -PS 



14c 



+ EV,-PS 



14 



Particularly when a lesson ^s many potential program skills 
sources (3f difficulty as Lesson 14\loes, we either need to pUt EV-H2 
into the instructional system to aici pinpointing of the- source or we 
need to increase length of the mainlike~^test . Fpr present purposes, we 

o the latter. Let EVj^-PS^, give way to the two| segment^ ^^1"^^^^^ -h 
^V^-PSj^^l^. ^Hence, the Level Z mainline s torage requirement is two 3-seg- 
program elements plus one 6-segment program eleitient, or two ^-minute and 
OT\e 12-minute program elements, , 

c We can continue to live with the decision to employ oply two 
Itertvafji versions of Level 1 sequences If we are willing to assume that 
L^evel 1 Sources implicated at Level 2 must arise simply due ,to "forgetting 
01^ a needHfor re'fresher instruction. This convenient assumption makes ' 
itXpossible tl^en .to recycle to one of the earlier versions even though 
bptn may foicmerly^xKave been used. . However, if the apurce Is found to 
be^at Level, 2 , then an alternative version of the Level 2 sequence will 
be needed. 'This requirement Is identical to that for Level 2 mainline 
instrii^tion (see preceding paragraph) . ' . 
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Only Lesson 7 is Level 3. It integrates the subsumed skills PS3 
and PSg. Treating it as we have Level 2, then mainline and looping 
instructional requirements each will be on the order of what we have 
shown at Level 2 for Lessons 3 and 6 . Thus, the overall storage 
requirement is for t^o 3-segment program elements, or two 6-minute ele- 
ments • 

Only Lesson 9 .is Level 4. Since it too integrates two skills— PS7 
and PSg — it also imposes an overall storage requirement of two 3-segment 
program elements, or tWo 6-minute elements. Only Lesson 15 is Level 5. 
It also integrates two^ skills~PS^ and PS^^~and so also impo^s. an 
overall storage requirement of two 3-segment program elements, or two 
6-minute elements . 

Like Level 1, Levels 2-5 each will require one alternative test 
per lesson that can be used independently of irfstruction following 
re(fycling to lower-level instruction. T^is adds five 1-segment (2-minute) 
and qne 2-segment ^-minute) EV program elements to the storage inventory. 
Table 1 summarizes • the overall s torage 'requirement ^ 



Table 1 

Number of Program Elements, Element Lengths, and Normal-Play 
Minutes f^r Mainline and 'Supplemental Instruction 



1 

» 

« 




No, Pj-ogram 


Element Length 


total Normal- 




Lessons 


Elements 


Segments 


Play Minutes 


Mainline 










EMS , 


0 : 


4 


1 


8 


Level 1 


. 9, 


27 


3 


162 


Levels 2-5 


6 




3 


30 






< I 




12 












Subtotals 




/ (37) • 




(212) 


Supplemental 




• 


* 




- EMS 


' 0 




4 


64 


Level 1 / 


9 


27' 


3 . 


162 


■\- 




9 


1 


18. 


Levels 2-5 • 


6 ^ . 


5 


3 


30 






5 


1 


10 . • 






1 


6 %c 


12 






1 




4 


Subtotal 




(56) 




(ioo) 


Total 


15 


93 




' . * 512 
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Since the illustration ik an absolute bar6-bones one, guaranteed 
to minimize storage^retrieval Irequirements when several Ss receive 
interactive instruction of moderate extent, we further assume that a 
single pace of instruction is employed, with variation in instructional 
duration occurring in consequeiice of differential supplementation of 
mainline instruction across Ss 1 Thus, each S will'"m:§ive 14 minutes 
of mainline instruction per da>^ (212/15) 6n\the average. This instruc- 
tion will feature presentation ipf 2.5 program elements pen day (37/15) 
on the average. Allowing 30 setonds for switching from^nfe element to" 
the next will consume an addit-ibnal minute 6n the average. Assume now ' 
. that the S having the highest adquisition rate wiH manifest a mainline 
to formal looping ratio of 4:1 ahd that tl^e S having the lowest acquisi- 
tion rafe will manifest a 1:1 ra^io. In consequekce, a child whose 
acquisition rate is average with \respect to the l/llustrative program will 
manifest a 2.5:1 rati^if the dis^tribution of rat/es is symmetrical. All 
(Ss will average 15 minut^ per day in' mainline instrucrion. An S having 
average acquisition rate tor the^ program will spend 6 additional minutes 
in formal looping instruction. Let us further assign to this S 4 ^tninutes 
per day of informal instruction and evaluation consonant with his going 
beyond the limited formal instructional materials that the illustrative 
program makes available for supplemental purposes. Thus, we define the 
30-minute session, fgr/ an S of average rate as consisting of 15 'mlniit^s 
of mainline- instruction, 6 mifiut'es of fortnal supplemental instruction,'- 
4 minutes of informal supplemental ins'tructioij, and 5 minutes of break 
time '(positioned jb/ E in the day's ln3 trii^;|.onai sequence on the basis 
of his perception of S's nefeds) . The conaiequence is that an having 
an average r^te will complete the program in 15 30-minute periods. 

W 

Thfe highest-rate S will Complete as much as the S of average rate 
in 21.25 minutes. If he als^ uses 5 minutes per day. for breaks, then 
he will compi:ite the program in 12.75 days. The lowest-rate child will 
^ complete as mch as the average 'rate child in 40 minutes. If h§^ also 
uses 5 minutes per day for bre^aks, then he will complete the program in 
24 days. Accordingly, the 13th day will be a worst case day for program 
storage.. ^ The highest rate child will complete the program that day, 
while the slowest rate child will be only half way through at the ^ 
beginnihg of the day.. -v 

The program is so devised that it is theoretically possible that^ 
any of the supplemental program elements might be required at any ptfint 
in instruction — a, condition I feel typically will prevail in interactive 
instructiom. Hem:ie, only mai^iline storage of program elements can be 
deleted on \he worst case day. At the beginning of Day 13, the slowest 
'rate child should h'ave completed approximately 106 minutes of .instruction. 
Completion Lesson 7 signifies negot^ISatloT^ of 108 minutes of the 
mainline treatment. This removes^ ^8 '!3-segment program elements from the 
Table 1 inventory. What remains as the worst day storage requirement 
is shown in Table 2. 
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Table 2 





Worst 


Day Storage Requirement 


/ • " 

/ ' ■ 




No. Program 
Elements 


Element Length, 


Total Normal- 
Play Minutes 




18 
1 

46 
8 
2 


2 

, 4 
6 

r- 8 
12 


36 
4 

276 
, ■ 64 
24 


^ Total 


75 




,404 



In consequence o^ an extreme accommc9dation to the system, we have 
managed to bring the worst case audio program storage requirement down 
to a level that is consonant with the contractor ' s view of audio storage 
as 96 programs. All that we need to do with this simplified illustration 
to make it exceed 96 programs on a worst case day is adopt the view that 
supplemental materials should reflect two alternative versions to the 
mainline version, rath-er than one. .Removing supplemental EMS elements, 
thife adds 48 program elements. Added to the 75-for a worst day, the 
system becomes overburdened in light of the , contractor 's view of 96-program 
audio storage, for the worst day requirement now becomes 123 program 
elements . 

Whatever may be true for audio is truer still for video. The 16-file 
view o£ video storage simply will not do. - 

The Looping Requirement ' 

It remains to determine how the modest looping requirement inherent 
in the oversimplified illustration compares with the contractor's naive, 
view that "first-level branching" epitomizes interactive instruction. 
The simplest (although probably not the most effective) approach to 
contingent instructional path specification for the illustrative program 
""^ras^HQ evaluated first. +Ho steps S along the mainline. -Hq leads to 
evaluation of' Hi. -HH^ leads. S into supplemental EMS instruction with 
exit to a second (off-mainline) version of the ins truct ionat-evaluative 

/program element for which -Hp was obtained. -H^ is interpreted as +H2, 
leading S into the supplemental second version of the program element 

^or which -Hg was obtained. If system software will not support this 
degree of contingent advance, then that portion of the software that 
addresses the looping requirement simply will be'useless. / ■ 
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PRESPECIFIED &VENT S^IQUENCES IN INSTRUCTIONAL EXPERIMENTS : 
IMPLICATIONS FOR IDdMS (TN 1-72-07) '• - ' . 

Joseph F. FolletCie ' " ' ' s 

''it' - ' " e» 

- V . ' 

Event sequences usually are pres?)ecif led in experiments. During 
execution of an experiment, E controls experimental events independently ^ 
' of'.charactei^istics of monitored performance. A minor exception to this 
rule is that?« S can cause ^experimental events to occur somewhat more 
quickly tti^iriv the limiting slowest speed at which they are programmed to 
occur if h|:"respcynds in less t,ime than event programming allows. Instruc- 
tional experiments at SURL increasingly allow S to speed the pace of 
events by responding quickly. However, programmed response time tends 
to. a suffic;iently minor component of most such experiments that the 
^f fec^ti^ of dif^rential response speed is to spread S's only modestly 
over.;^n experimental event sequence when they start out at the same 
point in the sjquence during a given .session— e . g. , 25-30 minutes. Even 
so, when twp of more begin from bhe same point in an event sequence 
and negotiate the event, sequence At the ^ame time, ^t is inevitable 
that they soon Will be \t differeti points in the sequence when rate 
of advance Of the event |sequence ii made con^ditional on, response speed. 
Hence, an event-control feystem appiicable to execution of instructional 
experiments necessarily allow||:he different Ss who participate 

in: an experimental sessi^ l^der s#tem control to proceed through the 
sequence at different rat^ds| The S|RL Instructional Development Con- 
trol and Monitoring Systenl (koCMS) |as this capability; it allows six 
Ss participating ^n a giveh feession -|o^ proceed at different rates through 
a given event Sequence . 1^ ^ |. 

Just how far such a capability Intends remains to be determined. 
For example^ the difference bfetween i|} event sequence that will allow 
six Ss of an instructional ex|eriment^each ^to have a minor effect On 
rate of advance of^events whi% parti^pating in the experiment for 25 
minutes and a series of event ^equencajs, one applicable to each of six 
Ss participating in such a session, is^^:bn the order of a fivefold or 
sixfold difference in. the stora^e-retrfeval-reproduction-control burden 
placed on the sy'^stem/* The optimal instpctional experiment routinely 
would control for tim'^^-of-day ef fects . To do so requires representing 
each treatment; equal)>,. of ten. at each time of day in which sessions are 
scheduled. Thus , we 'fiiust eventually require .systems of-the IDCMS type 
to serve at least a&^^ny Ss as there are treatments in the instructional 
experiment and to ^ (pa^rtially) \coRtrol event occurrences belonging to as 
many different sequences as. there' are treatments in the experiment. 
Thus, if the experiment features four treatments, then the requirem^t 
for input-output terminals is four or a multiple of four and the require- 
ment for control span is four session-long e.vent sequences. If the x 
experiment features six treatments,' then the requirement for " terminals . 
is six or a . multiple of ' six and that for control ^pan Is six such 
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sequences. The system'^ capability for effecting (partial) event con- 
trol should be evaluated for the illustrative six-treatment instructional 
experiment to be described. 

Althoxigh response-monitoring functions will be. vested in E in 
remarks'^hat follow, IDCMS has a response-monitoring capability for 
/Certain ' typfe"^ of responses not of interest here. The system's capability 
for monitoring responses conti;asts with its capability fof monitoring its 
own event-controls, and response-monitoring behavior. In the evw^-contir9l - 
domain, an assumption -^that the system can control an event s^^^ence- of ; . , 

interest referencin^to seA?eral Ss served at the same time is aiji aasafiip^^;; ' • 
tion that the syst^em can monitor its own event-controlling 'tehavi^r ^ ^ t. / | 
consonant with remj|ired event control. It is redundant tc?.'speak^ of', an . % 

event-control ca]5ability and a capability for monitoring event-^dontrol - 
ling behavior consonant with event-control. 

Current instructional experiments typically are conducted in a 
manual mode; thi^*" term simply si%nifies that E is considerably burdened, 
with response-monitoring and event-controlling activities during the 
conduct of an experiment. The consequence typically is a series of 
costly compromisers which, on the one hand, reduc^ the usefulness of a 
datum and, on the other hand, make the cost of a datum so high that 
one seldom can afford the volume purchases of data that resolution 
of complex^nstruct ional problems requires. An optimal alternative 
to manual mode execution of instructional experiments is automatic 
mode^execut ion . ' Study execution would be in automatic mod6 if E's 
presence in t;he response-monitoring and event-sequencing roles were 
unnecessary. Moreover, the well-^documented advantages^ that machines 
enjoy over* people' when complex clerical behaviors are required should 
insure' a diirtinution in costly compromises during study formulation as 
one moves -away from manual mode execution and toward automatic mode 
execution. IDCMS will not make E's presence unnecessary, but it pro- 
mises to relieve E of some event-controlling (and, in some situations, 
response-monitoring) functions. In consequence, the system promises to 
move instructional experimentation in the direction of automatic mode 
execution — an important implication of which is that such experimenta- s 
tio-n can increase in complexity as the phenomena under study warrant. 
The primary purpose of this paper is to specify a minimal set of char- 
acteristics that IDCMS must possess to relieve E^of'an appreciable 
amount of the event-control portioil of his current manual-mode, study- 
execution burden. We do this by indirection. That is, an instructional 
stu(Jy now in formulation is described well enough to. guide those charged 
with system exploitation an<^ evolution concerning how the system will be 
used in support of SWRL instructional research. The illustrative study 
will be executed in manual mode; we ask the system to support ^^s^cut ion 
of such sttidies in such a vay that study effectiveness will be ennatqced 
through diminution of a need to make compromises stemming from event- 
controlling limitations of E and study efficiency wiH^be (con^derably ) 
enhanced in the cost-return sense. 
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A study now being formulated by John Koehler illustrates the s^ort 
of instructional experiment we wish to be able to prepare for and 
execute routinely and cheaply at SmL. Unlike experiments that typify 
the instructional research domain, the Koehler study rises to the 
challenge posed^ by, the Instructional problem, which is complex. Even 
so, manual-mode resources have necessitated some compromises with what 
we view, as an effective response to the problem; manual-mode study, 
execution precludes the rate of return in findings that we must have 
to reach definitively effective* instructional de^signs in less than the 
long term. An acceptably useful IDCMS will permit both the study of 
more-complex event sequences th^n the Koehler study'will evaluate in 
manual mode and the pursuit of a sharply accelerated rate of return in 
findings per unit resources. 

Although the emphasis below \H.ll be on sequencing-control of experi- 
mental events, IDCMS has other functions that bear, only slightly less 
on improved effectiveness-efficiency of instruction research. A few - 
comments on these other fuirctions are in orde^r. All visual displays 
to be used in the Koehler study are alphanumeric (or, even more narrowly, 
"alphaic," sinc^ each is composed exclusively of at most four alphabetic 
characters). Research efficiency would be enhanced if the system's 
character generater could be fised to produce camera-ready materials . 
underlying the loading of such materials into the system's video (frame) 
storage. While the matter requires evaluation, my guess is that the^ 
system in Version 1 configuration will have soch a capability. 

A rough estimate is that the Koehler study will-require at most 
400 unique visual displays (slides in projector terminology, frames 
in system terminology). Manual mode execution of the study necessitates ' 
much duplication of the basic set of 400 frames. That is, to hold E's 
event-controlling burden within reasonable bounds', it ^s necessary that 
a set of. approximately 1750 slides per E be prepared , sorted , and stored 
for use during study execution . While the study as formulated will pro- 
cess Ss four at a time, if it were executed in manual mode under con- 
ditions comparable to execution under pa^rtial -system control, it would 
process Ss six at a time.- To do ^his would neces^s^^^te that 10^500 
slides be prepared, sortjed^ and sto^r^d for use during s^udy execution.' . 
Actual manual-mode execution will nec^^'&cUate that each &a&lc slide on 
the average be duplicated on th^order of 3^7 times; manual-mod^ 
tion that is comparable to exeputibn under system support would 
sitate that each basic slide o^_tii&-a\ferage be duplicated on t 
of 26 times>^While the mat^r requires eva^ation, my guess i 
the system in^Ve^i^ion 1 configuration would necessitate no duplication 
of visual displays wba^^ever. That is, ev^ if it were required tha 
a given visual display be-^-pIaced in the systetn^ visu^^^^"®?^ more 
than one tr^k, the saitfe single camera-rfesidy dis'^S^^ couM^be^^^^s^ for 
ttiis purpose. Rox^ver, duplication even in the sensfe^of mult ipife^tOi.«a' 
addresses, if required, will be minimal , "because each S""i^provided with 
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a video buffer to which the frame in master video storage can be cjupli- 
cated. In consequence, if the system can produce Koehler study visual 
displays in camera-ready form, then if the cost of a single display is 
50 cents, the study -under partial system control woi|J.d cost $200 for 
materials preparation, while a comparable study in manual mode would 
cost over $5000 for materials preparation. Unfortunately, this is not 
he entire cost of large materials requirements based bn a high level , 
of duplication. Inevitably, respoase time is a function of the materials 
F^uirement. In some sense, materials requirements of the magnitude 
innfe^rent in the Koehler study necessitate waits that set back stud>\^/;.f 
execution. In some sense, this necessitates i^n turn that specialized,''-, 
professional staff will be less effectively employee} , than would other- 
wise be the case. 



V 



Wtiile the Koehler study tends to fall at the upper end of a scale 
for complexity of instructional research a3 this is conducted in con- 
temporary research settings, it tends also to fall at the lower end of" 
such a scale when the scale is defined on SWRL requirements for infpr- ^ 
^^mation that resolves germane instructional problems. Hence, the quanti- 
tative implications of- the Koehler study folr audio and video storage 
must be taken as underestimates of the system-burdening requirements ' 
that such a system must be a^ble to handle in the years immediately ahead. 
A temptation was for the most part resisted to make the illustrative 
study more complex than the Koehler study because it is more difficult 
to argue away the inconvenient facets of actual wqrl^ th^n it is to argue 
away the inconvenient facets of hypothetical work. 

The^ Koehler study features six iristructional treatments, each 
applied to one treatment group of 12 Ss ^n^ex three successive test-train-^ 
test cycles. Ss kre K-1 evel. The Koehler scfiedule calls for preli— ^ 
minary entry s^/ls evaluation on Day 1, Cycle 1 training on Days 2-3, 
Cycle 2 training on Days 5-6, Cycle 3 training on Days 8-9, and inter- 
vening post-training and entry skills testlrtg on Days. 4, 7,^and 10. 
O^re.^^ the few liberties we take with Koehler 's formulation l^Bb^o col-r 
lapse^b^xe^ schedule to ei^t days, with testing occurring on Day^lf^nd 
toward the^^end bf Days 3, 6, and 8. The iat;ent here^J-S not pedagogteal', 
but rather to^.^tress the system a bit more th^ the Koehler schedule 
would*. 



It is assumed here t^iiat the system should store, consonant with 
momentary retrieval and rep^H^uction to S's audio and vJ.deo buffers,^ all 
of the materials that will be uaed during one experimental day. This 
assumption frees us' to schedjile sessions tightly so as to fully exploit 
the school day; this, in turn, creates most-favorable systek amortization 
conditions.^ The object is to schedule the Koehler experiment so that 
the worst-4ay ^t^orage rei^uirement can be identified. The basis^or ^uch 
scheduling, while straightforward, involves production of much detail'. 
This detail, in the form of flowcharts and tables, is presented irju^ppen 
dix A, together with a^rnore extensive description of the study than • 
be provided here. Koehr^ has instituted a two-way control for amount. 
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of training across Lre<itments within cycles: a) number of training, res- 
ponses per treatment per cycle and b) associated training time. We use 
his values for number of training responses and a fr^jmew^k that appea^rs 
compatible with IDCMS to estimate associated trafning tim^ While 
training times as derived in Appendix ifpre characterized rns those for ^ 
an S whose response speed is a median ya^e, the possibility of variation^ 
in response speed in a study of the Koehler type is over a constrained 
range. Hence, these times do not probably seriously underestimate train- 
ing times for the slowest-respdnding study S. The t rain ing- testing 
schedule to bd presented, assumes thqi following: 



1. Th'irty^minute seS 
housekeeping events and re 
order of 24 tijinutes. 



bns wherein six minutes are given" over to 
t breaks. Hence, study event time is on the ^ 



2. iVelve consecutive sessions per sch(xrh-4ai;,t> eg inning at 8:30 
a.m. and ending at 2:30 p.m., with six Ss particlpatiiTg.4r^ 
Hence, the study N of 72 Ss in tot a will participate* during^each experi-- 
meotWl day. (This is nb mere extraneous requirement . . A persis 
problem of mostrifTstryc1>ional research is that dif^ferent batches cx^ 
.children entet^^tjieexp^^ diff^^nt points in the\ 

school year. This"^^^B-ielativeiy^ at higliet^^rade levels but 

ca>r-^e devastating at the^S^evel . While j^onfpundina^jroic^durea exl^st 



Oiereby one can control f or ef f e(rts^6f \iif f^r^ent amounts of prior, school , 
>experience><his can only be. done at ""a>^Qst in error variance; 
">ost can alsoS^characteriz^^s a cost in^^^^s^udyxef f iciency . )--^ ^ -^^^^ 

Since^ Day 1 per fb-^^nance condilions ;assignment to groups. Day 1 
experimental eVents WllSve conf ine<i to a preliminary entry skill's- test. 
In consequence, 10-minute se&s^ons will c|iaracterize Day 1.* Sessions ' 
on all other days will be 30 minttt^. . TableL shoves how the Koehler 9 
study would be scheduled consonant with fhe data pre s en ted^or derived 
in Appendix 'A and forgoing ^assumption The derived traln^!^ times 
Wlecte4. in Table 1 mefe^-lCoehler * s^ requirement that each" tre^ment \ 
group, receive about the sa!ne\^ojunt of training during a given^^le 
(see also J^bles A-21 and A-22)|^^they also appear c?onsonant with KgehlerXs 
Views on t;;daning .time expenditures that the study will encounter.^ 

For ma^f^om^eiiing .reasons thaKgo^eyond the purview of this ^ 
papery the syst^ must eventually evblve tb^a point wherein it permits .^^^ 
on-iin^apid composition of programs from the fewest number of elements^ 
that aretonsonant with such an pbjective. However, Appendix AXdefines 
the program as a unitaryfentry in storage ^uch that the requin^ei^ts on 
the system are only those of retrieving a program on command and reprb- 
>d\acing it to the buff-er. of * the S who is ready to negotiate the program. 
Events within a given prbgram occur 'in fixed sequence X Table 1 reveals 
for a ^iven treatment group, the^pro^rams that apply to the group 
unemselves will be negot iated.-in <ixed 3equence. All that will vary 
acrol^-^o or more Ss negotiating a) given stretch of a treatment^ set, ' 
of pi^ogra^is^uring a given %ssion is that these Ss ma> vary just a 
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Tabgie 1 



Training-Tesjping Schedule, by Treatment Group and Typ^of Prograih*" 



Type of 
Program 



Treatment Croup 



• \ 

— ■ — V 




• SI 


Bl 


CI ' 


S2 


82 


C2 


I 

"i ( 


ET- 1 


7-. 5 


7.5 


7.5 


7.5 


■ 7 . S 


7-5 


) 


1/Tl.O 


3.3.' 




3.3 


3.3 




3.3 




1/T2.1 \ 


1,9.0 




9.7 










1/T2.2a 








9 .6 




'5.0 




l/Tl'.'ih 








9.7 •• 




,5.1 




\l/f3.0a 


2.1 


2 .1 


2.1 ^ 


2-1 


2.1 ■ 


2.1 ■ 


> 


1/T3.0b 




2.1 


2.1 




2 . 1 


2 , 1 ■• 




1/T.3.0C 




6.8 


6.8 




6.8 


6.e 




1/T4.1 




13.0 












1/T4.2a 










12.5 






Totals 
» 


■24.4 


24.0 


24.0 


24.7 


23.5 


24.4 




















1/T3.0b 


2.1 






2.1 








■ 1/T3.0C 


6.8 






6.8 








1/T4. 1 




9.1 


9.7 










1/T4.2a 












6.5 




1/T.4.2b 










9.7 


3.5, 




-. PT-l 


6.7 


6.7 


'6.7 


" 6.7 


6^.7 


6.7 




ET-2 


7.5 


7.5 


7.5' 


7.5 


7'. 5 


7.5 




Totals ^ 


23.1 


23.3 


23.9' 


2a. 1 


23.9 


24.2 



2/Tl.O ' 
2/T2 .1 
2/T2.2a 
2/r2 .2b 
2/TJ .2c 
h<T3,0a 
, 1/T3'."0b 
1/T3.0C 
Z/T4.1 • 
2/T4.2a 

lotals 



5.8 
18.2 



24.0 



J 



2.1 
2.1 
6.8 
13.0 



24.0 



5.8 
18.5- 



5.8 
17.5 



2.1 

2.; 

,6.8 
12.5 



2A.3 



2 3.3 



23.5 
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5.8 

8.2 
5.0 
5.1 



24. 1 
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Table 1 - cont'inued 



T^e of 
Program 



Xreatijient Group 



SI 



Bl 



CI 



B2 



C2 











- . ..^ 






5 2/12.; 


•18.4 








^ 4 




' 2/T2.2B ' 


fe * ' 






11.8 . 


• 




2/'®2.2c 


'■' 










^.1 


1/T3.0a 


2.1 




2.1 


2.1 




1/T3.0b _ 


2.1 




2.1 


2 .1? 


• 


2.1 • 


1/T3.0C 


1.4 




6.8 






6.8 ^ 


2/TA.l 




24.0 


13.0 








27T4.2a 












6.5. 


2/T4.2b 






* 




11.8 


5.0 


• 2/T4.2C 










12,2 


1.5 


Totals 


24.0 


•24.0 


* 

24.0 


' 25.7 . 


24.0 


f 

24.0 • 



1/T3.0C 


5.4 






6.8 






2/T4.1 




5.7 


5.5 








2/T4.2C . . 










6.3 


8.0 


PT-2 


6.7 


6.7 


6.7 


6.7 


\ 6.7 


6.7 


ET-3 


7.5 




7.5 


7.5 


\7.8r' 


■ 7.5 


3/Tl.O 


4.6 




4.6 


.3.6 




■ 2.5 


2/T3.0a 




2:6 




V 






Totals 


24.2 


22.5 


24.3 


■2'4.6 


23.1 


.24.7 



3/Tl.O 
3/T2.1 

-3,/T2.2a 
3/T2.2b 
3/T2.2C 

*2/T3.0a 
2/T3.0b 
2/T3.0C . 
3/T4.1 
3/T4.2a 

Totals 



18.7 




23.9 24 ..Q 





1.0 




2,1 


9.1 


il.3 
5.2 
3.7 




5.1 
2.8 
2.1 


2.6 


2.6 




2.6 


2.6 




2.6 


2.6 


8.8 




8.8 


6.7 



12.5 



23.1 



23.8 



23.9 



24.0 
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Table 1 - continued 



Day 



Type of 
Prograip- 



SI 



Treatment Group 

♦ 

Bl CI S2 



B2 



C2 



2/T3.0b 

2/T3.0C 

3/T4.1 

3/T4.-2a 

3/T4.2b 

PT-3 

Totals 



8.8 



6.7 



U.l 



6.7 



9.7 



6.7 



2 .6 
8.8 



y.^ 11-3 

■h.f 6.7 



2.1 

6.5 
5.1 
6.7 



15.5 



17.8 16.4 18.1 18.0 
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little in time to completion of that" stretch.. Table 2 shows day-to- 
day storage requirements that the Koehler study, as s<:heduled in Table 
1, requires. We take th^ requirements as thoke that must be" met on 
a momentary basis; that \iB-, the syst'em must be able to retrieve and 
duplicate to an approprikte buffer any of the materials applicable to 
an experimental day' at Any time during any session of that day. - 

The worst case d'ays for number, of audio programs are Days 2* ^nd 7. 
In either case, the system must store in audio master reproduction 40 
short programs. It is ifty impression; but requires evaluation, that^ 
such a storage requirement, underlying quick retrieval and duplication- 
to an appropriate audio ; buff er is well within sj^stem capability in 
current configuration. A matter that fehould be explored more ^ully is 

'whether the system can handle the program repetitive and interrupt 
functions 'described in Appendix A. These programs are designed so as 
tb require audio buffer to stop between subprograms and to rewind to 

'program beginning as multiple trials of the Koehler study require. , 

The ^orst-case day for amount of audio tape— in nortnal-play minutes- 
is Day 6. It is apparent, that all rei^uired audio programs are at least 
fivefold shorter than the sys/rfem will allow. Hence, the information on 
program lengtii is less cruci/l than t|iat on number of programs. ^However, 
it is instructive in the senhe that it documents the research staff con- i^ 
tention that the present hardware configuration of IDCMS wastes most of 
the audio Vrogram storage that it provides, when judged against SWRL 
research requirements. We may find it necess-^ry in t;ime to require the 
. system to store more than 96 different audio programs. It is doubttui 
that we ever will require it to store more than 96 x 15 (or 25) minutes 
worth of laudio programs.' The 15 (or 25) minute' program length engineered 
into the system .^n present configuration is virtually useless when 
instructional research is to be supported. 

Day 6 is a worst-case day for video frame storage. While the 106 
frames requiring storage on Day 6 poses no problem in Id^ghrt-^t^ie IBOO 
track video -Storage capability, the l6-flle view of vide* stor^e that 
" underMes current system engineering is inconsonant with the Table I 
Day 6 requirement that these 106 frames ■ reference to 38 different audio 
programs. While many of these programs share the same video frames 
(the 12 PT-2 programs, for example), these frames must appear in different 
orders in the different programs. A central matter requiring early eval- 
uation is whether the system in current configuration can yield the video 
correlation to audio programs which Day 6 (and, in fact, every other 
experimental day of the Koehler study) requires. If not, then priority 
must be given to securing such a capability; for it becomes a bottle- 
neck that sharply constrains the uses to which the system can be put. 

While not of central concern here, it requires comment that a 
system that is consonant with requirements summarized in Tables 1 and 
2 suirely would effect a variety of economies for which instructional 
resear^rh would be a prime beneficiary. Remarkable staff x^avings in the 
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Table 2 

» # a 

Per Day Materials Storage-Retrieval Requirement ' / 



Type of „ NumbeKof *, Program V Frames Total Tot4l 
Day Program Programs Length /Program Tape V Frames 

V, (min) (min) 

















I ET-1 


6 

h 


3.1 X 


28 




18.6 


^ i 




J 1/Tl.O 


4 


.5 


■T^ 




2.0 


4 


1/T2 .1 


4 


1.0 


4 XT' 


4.0 


8 


1/T2 .2a 


■ 4 


1.5 


6 




6.0' . . . 


12 


1/T.2.2b 


4 


1.0 


4 




4.0 


8 


1/T3.0a 


4 


.8 


p 




3.2 






l/TS.Ob 


4 


.8 


6 




3.2 


12 




1/T3.0C 


4 


1.6; 






6.4 






1/T4.1 


4 


1.0 


4 




4.0 


8 


1/T4.2a 


4 


2 .0 


'8 




^.0 ^ 


16 


Totals 


36 








40.8 


68 




3 1/T3.0b 


4 


.8 


[^] 




3.2 


[u] ■ 


1/T3.0C 


4 


1.6 ' ■ 






6 .4 




1/T4.1 


4 


1.0 


4 




4.0 


8 


1/T4.2a 


4 


2.0 


8 




8.0 


16 ' 


i/T4.2b 


4 


1.0 


4 




4.0 


8 


' PT-1 


12 


2 .0 


20 




24.0 


" 20 .0 


ET-2 


6 


3.1 


28. 




18.6 


28 


• Totals 


38 








"68.2 \ 


.92 


4 2/Tl.O 


4 


• 9 


4 




3.6 


8 


< 


a/T2.1 


4 


2.0 


4 




8.0 


8 


2/X2.2a 


4 


1.0 


4 




4.0 


8 


2/T2.2b 


.4 ■ 


1.5 


6 




6 .0 


12 


2/T^.2c 


4 


1.0 


4 




4.0 


8 


1/T3.0a 


4 


.8 






3.2 






1/T3.0b 






6 




.3.2 


12 




1/T3.0C 


^ 4 


A. 






6,4. 






2/T4.1 


4 


2.0'- 


4 




8.0 - 


8 


2/T4.2a 


4 


2.0 


8 




8.0 




Totals 


40 




3 




54 . 4 


SO 


^Bracketed frame 


entries are 


common to sets 


^T3.0 


programs . 






• 
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Table 2 - continued 



Day 



Type of 
Program 



2/T2.1 

2/T2 .2b 

2/t2 .2c 

1/T3.0a 

1/T3.6b 

1/T3.0C 

2/T4.1 

2/t4.2a 

2/T4.2b 

2/TA.2C 

Totals 



Number of 
Programs 



Program 
Length 
(min) 



V Frames 
/Program 



Total 

Tape 

(min) 



Total 
V Frames 



A 


2.0 


> 


A 


8.0 


8 


A/ 


1.5 




6 


6.0 . 


12 


A 


2.0 




8 


8.0 * 


16 


A - 


►8 






3.2 




A 


.8^ 




6 


3.2 


12. 


A 


1.6 






6. A 


_ 




2.0" 




A 


8.0 


8 


A 


2-0. 




8 


8.0 


16 


2 


1.5* 




6 


3.0 


12 


a" 


2.0 




8 


' 8.0 • 


16 


38 








61.8 


100 



1/T3.0C 


A 


2/TA.l 




2/TA.2C 


\ A 


PT-2 


12 


ET-3 


6 


3/Tl.O- 


A 


2/T3.0a 


A 


Totals. 


'■38 



V 



3/Tl.O 
3/T2 .1 
3/T2.2a 
3/T2 .2b 
3/T2.2C 
2/T3.0a 
2/T3.0b 
2/T3.0C 
J/^TA.l 
>3yTA.2a 

Tota^ts 



A 

A 
A 
A 
A 
A 
A 
A 
A 



1.6 
2.0 

2.0 

2.0 
3.1 
.7 

Lll 



.7 

1.5 
1.0 
.8 
.5 
1.1 
1.1 
2.1 
1.0 
2.0 



6 


6. A 


12 


a' 


8.0 


8 


•8 


8.0 


16. 


20 . 


2A.0 


20 


28 


- 18.6^ 


28 


3 


• •2... 8.' " 


6 


8 


A. A 


. 16 




72.2 


106 



3 
6 
A 
3 
2 



A 
8 



2.8 

e.o 

A.O 
3.2 
2.0 
A. A 
A. A 
8. A 
A.O 
8.0 



6 
12 
8 
6 

A 

16 

8 
16 



AO 



47. 2 



76 



128 
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Table 2 - continued 



Day 



Type of 
Program 



311 



Number of ' 
Programs 



^Program 
Length 
(min) 



V Frames 
/Program 



Total 

Tape 

(min) 



Total 

V Frames ' 



2/T3.bb 


4 


1.1 


[»1 


■2/T3.0C 


4 


2.1 




3/T4.1 


4 


1.0 


-.4 


3/T4.2a 


4 /' 


2.0 


8 


3/T4.2b 


4 ' 


1.0 




PT-3 


12 


2.0 


20 


Totals > 


32 







4.4 
8.4 
4.0 
8.0 
4.0 
24>Q 

52.8 



[16], 

8 
16 
8 
20 



X 



68 



< 



ERIC 
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form of more, apt use of specialized personnel should result; these 
savings would be transformed into the higher rate of acquisition of 
germane findings we must have to achieve definitively effective instruct 
tiona.1 designs in less than the long term. 
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APPENDIX A 

^ bUTLINE OF THE KOEHLER STUDY 



A study now being formulated by John Koehler illustrates contem- 
porary instructional experiments. While this -stiidy wil-t^be conducted 
in the manual mode during Spring 1972, we view it from a sy^<em control 
standpoint. We ask what characteristics ^a^conLrol-monitoring sy^em 
must have to permit shi££jjag-most ef the event qontrol burden of m^u,nl 
mode execution of the Koehler study from E to the system. 

Tlie study compares alternative instructional treatments of a phdnic 
approach to reading for effectiveness. Excepting that treatment groups 
are formed on the basis o,f comparable germane entry skills, no facet 
of the study is conditional on any characteristic of S's performance. 
Kach of several types of' response to be studied must occur in less 
than a generous amount of time. To minimize subsequent data reduction, 
K. will^ (quickly) evaluate responses as these occur. Were the study 
under** system control,. E would feed the proper evaluative code t^ the 
system for recording immediately following each response, ' \ 

The study occurs in three cycles. These cycles differ primarily^ 
in the lexi caltrphonemic structure of th^ words whose processing is to 
be instructed and tested. Cycle 1 features CVC words (e.g^., SAP); 
Cycle 2, CCVC words (e.g., SNff) ; Cycle 3, CVCC words (e.g., SINK). 
Each Cycle is characterized by its own 3-segment entry skills test and 
/it^^'oivni 3-segment post- training test; the intervening training for a 
cycle consists of one of six training treatments each of which is fui'tlie 
differentiated according to which of two sets of instructional materials 
is used, . " " 



ET and PT Tests 



Denoting' entry tests ET, post-training tests PT,. ^ test segments A, 
B, C, and cycles 1, 3 , then test notation is ^s shown in Table A-1 , 

All Ss receive all tests in the progrespion ABC, Segment C post- 
training subtests — PTC-1, PTC-:2 , -PTC-3 — are l^^ two\ alternative versions, 
one appropriate to- half of the Ss and the \3tlfer appropriate to the other 
half. Otherwise, testing is identical acrossps, regardless of training'. 
Described in order below are: a) ETA and PTA Vubt^^ts and associated^ 
control requirements, b) other subtests, and c) cycle-by-cycle ET-and 
PT storage requirements and t'he'^time i^t will take " to \t:est the ,72 Ss 
u§ed in the study when-sii S^ at ''^ time are tested under^ system control. 
Testing and training time values are of iriteirest becae^Wingle day 
(or session) storage requirements stem from timing a study over sessions 
and dbys using such values, • " ^ 
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- , , " Table A-1 

J Test and Subtest. -Notation and Progression of Activities 



Cycle 


1 


Cycl^- 2 


Cycle 3 




1 ' 2 


3 


1 


5 6 


7 8 • 


9 


ET-1 Tng 


PT-l 


ET-2 


Tng PT-2 


ET-3 Tng 


PT-3 


ETA-1 


PTA-1 


ETA- 2 


PtA-2 


ETA-3 


PTAt3 


ETB-1 


>.PTB-1 


ETB-2 


PTB-2 


ETB-3 


PTB-3 


ETC-1 \^ 


PTC-1 


^C-2 


S PtC-2 


ETC-3 


PTC-3 




» 






% 










>' 


X 





erJc 
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ETA and PTA Subtests ^ . 

ETA subtests differ in form from PTA subtests only in that ETAs 
consist of an example followed by six test items,, ^whereas PTAs dispense 
with the example. (Different items are used on the two subtests; how- 
ever, this is a difference in content rather ^tjian form.) For purposes 
of analysis^, the only signif ican^eofSaa..^example is that the subtest 
will consist of seven br six items, * * ^ 



Examp~tes.^^d test items all have the rolTowing forrnT^ 

eo frame (V i . 1) containing Lv^o^pr inted words (Wi on the 
left, W2 on the right) is presented with arr-aiidio accompanyment (A i) 
that pronounces first and then W2. 

2. Then V^i.l is superseded by V i.2, wherein' is at top left, 
W2 is at top right, and W3 is boxed at bottom center. 1 

^ 3. S is required to attempt- pronunciation of W3 — 5^1= Try /W3/. 
(Slant brackets inaicate audio pii^sentat ion or aural responding . ) S is 
encouraged to make S^i as quickly as he can (communic^ed beforehand a 
during an interval that precedes system control of the testing sequence) 
S is allowed ^t most 12 seconds from onset of V i.2 to complete the 
response. , 

4. As soon as S responds, E quiclTlyx. evaluates the response and 
then immediately addresses the system. If the item is an example 
rather than a test item, then E presses an Ex button, signifying an 
order to advance without recording — Ej^i = Ex (a B^jnnnand). If the r^Sr 
ponse is to a test item, E p^i^sses one ^of eight evaluation code buttons, 
signifying an order to advance, coupled with orders to'record the code 
and a^suitable response time ijieasure — E^i = Code i.2 

There are three versions of each ETA and PTA, one for each cycle 
of the study. Desirably the order of test items would be varie^ -.Jor 



iThe Koehler study will make do w.ith a single visual fl^ame- — V i ^ 
rather than' V i.l + V i . 2^-because ^ this lessens the m^t>«rials ^repara- \ 
tion and frame presentation burdens.^ IDCMS should \b'e requir^i^'to -mak^ 
j.uch a combrpmise unnecessary. • ^ ^ "^^^ 

, ^The Kjjehler study will not ^collect response time measures because 
to do so_jw€Juld add to an already extensive burden placed on E. IDCMS 
should be req,uired to make sucH relinquishment of relevant data unnec- 



essary. ^ ' ^ 

3 



13 



each verstcm.of each subtest.^ Tf^ttnent group size is corrsonant with 
our praVding six orderk for each sbc-item subtest--e . g . , 1st: 12345f)., 
2nd- 56^342, 3r^hK2 165^0^ Ath : 3A5621, 5th: 65213A, 6th: 431562. 




Required that each JT^^ ETAs and 3 PTAs (and all other subtests^ 
occur in 6 versions that difier-^rr^PT test- item order, one s choic 
are to require the system to conTpose tests on-line (or nearly so) -frQm 
item files for each subtest pr to store the different versions as / ^ 
fixed sequences. The systeni. iR Version 1 configuration cannot , do/the 
former unless somewhat modified. -Whether it- can do the latter withput 
l^o-dification depends on how many audio programs and assocdated vicTeo 

frames are to be stored, together with extentyfcf these files. The 
■ papBi^which this analysis is appended suflma^^izes storage requiremen^- 
e.g , the req,uirement for one day (or session) of study execution. 
Below we will evaluate the normal-play elctent of audio tape and the 
number of video frames that the .ETA and P-TA' requirements outlined above 
entkil. ' . \ 

Figure A-l-slTDtts^he event control scheme overt time for an ETA 
or PTA item. According to the scheme, each 'item's audio component will 
require 9 secqnds of single-track tape (with megs:age and 55 HM codes 
merged) A^33. 75 inches of tape. Associated wit;h this audio element 
will be 2"A?ideo frames. Thus, a given..^rsion of ETA will use 6J 
-^seconds of tape and lA video frames. Assuming file identification needs 
that are additional to the foregoing, then a version of ETA might be 
taken to require 1.2 minutes of audio tape and 15 video frames. We 
call su,ch a tape an audio program , it is assumed. t>iat every presenta- 
tion or presentation sequence will have an audio .program that enters 
into syst^ control of the presentation. This will be true whet>er 
presented stimuil are audio . 'video , or audio + video. A version of ETA 
will require 1.0 minutes of audio tape and 13 video frames. Based on 
6^item orders multipled by 3 cycles, program reqtiirements in support 
of Segment 1 testing are : ^ 

. Ik 

■ 1. 18 audio programs of 1.2 minutes juration (21.6 minutes) + A5 
video frames (15 frames x, 3 cycles) for ETA. - ■^ . 

2. 18 audio programs of 1 .0 minut>^ duration (18 minutes) + 39 
video frames (13 frames x" 3. cycles) f^ ,PTA-. • 



^The Koehler study will not vary te^t item order, fsor subtests 
^ecause'to do so under manual adi^inistration would risk'*httrlbuting a 
wrong order to a given S; E has to ^jnaay other things t(T do" during 
manuar\dministration. IDCMS should^^^be^ required, to mak^such a com- 
promise unnecessary, v ■ 
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Other Subtests' 



All ETB "etc, PTB, and^PTC subtests will consist^ of 6 test Uems 
withQut a p^ceding-^x^ple.; Pii^ A-2 and A^^^ow event conbfol ^ 
''.scbemes^ior E^t and ETC iteI3^< respect ivel^r^iguta^ A-4 and A-5 show 
--such schemes for PTB and ^TC ite^. PTB<' items require different types\ 
of responses, depending o/^Wttjer ^training features a single-letter or 
bi-part Strategy (the tpdir^ing sttategic factor of a 3 x 2 design for 
training treatments) . /PTC itemS r^ 
sei:itation, depejidi^ng/on whether tri 
' bi-part ^strategy.J'^TC subtests thtref^ 
sions per-cycle, ^one 'that tests fot^t 
. ing strategy and one that tests /oi 
strategy.''; 



* Figure^--^ indicate stJ>W: 
audio tape and 2 vide^Kff^es 
seconds of tape and 12 video fr-ames 




n^<ypes of item pre- 
single-lgtter or ^/ 
two alternative ver- 

single-letter train- 
' bi-part training 




ETB 



Tice , 



X 

se 7.5 seconds of 
an ETB subte^ will use 45 
sing the reasoning ^(applied • ear- 



we 



dl^lU it. V -1- U ^ ^ ^ A. «-f It '-t ^ o — . - " 

ifTcreas^ the requireni.nl td 53 secon^ of tape and 13 



lier to ETA,-^ . . a 

vi'deo fraffi^r: Figure A-3 indic^es that each^- Item will use 8 
seconds of audio tape^-there is n^Kvideo requirement. Hence, t.he ETC 
subtest will use 48 seconds of ta'pe^^jrtiich we increase to' 56 seconds. 
Figur6U^-4 indicates that each PTB item will ^|^3.5 seconds of tape ^ 
■and 1 video f ramfe . - Hence, a PTB subtest\wiL3«e 21 seconds of, tape / 
and 6 video -frames, which^^e increase to 25PK)nds of tape and 7 vidfeo 
frames. Fi^te A-5>indicates that each PTC item will use 3.5 second^ 
of tape— therl is. no video requirement./ Hence, the PTC subtest wil?. 
use 21 seconds of^tape, which^ weWcreas^to 25 seconds. 



/ 



Program requirements 

1. 18 audio program 
video' fraines for ETB. 



and- 3 testing 



(16.2 minutes) + 39 



2. 18 audio pVWVams of 



3. 18 audio programs \f 
video fr^as 'for PTB. 




4 3§ audio programs (3 cycle versions x 2 trainiril strategy 
versions x 6 test item orders) of .5 minutes duration (18 minutes) for 
PTC. 



Cycle-by-Cycle Summary 

Table A-2 shows required program material's by cycle and test. It 
is worthy of. note that the three segments of a test will occur^ in fixed 
sequence. Hence, the se^gments of ET tests can be stored aa/^sTngle pro- 
fisrams (if stop codes arB used at the ends of segments) for unitary 
retrieval and reproduction to audio buffer, thus reducing these programs 
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to '6 in number (orfe per test item order), each consisting of 6.1 minutes 
af tape, referenced to' a video file containing 28 f rallies, whose sequencing 
will-be a function of test item order. The same is true for^PT tests, 
except that alternate training strategy versions., of PTCs necessitate- 
that there be 12 three-segment programs, each 5.0 minutes in tape length 
and all referencing to a video file containing 20 frames whose sequencing 
will be a function of test itew order. 

Average item negotiation times for ETA, ETB, ETC, and PTA subtests 
should be on the order of 15 seconds. Average item negotiation t^mes 
for PTB and PTC subtests ,; respectively , should be on the order of 12 
and 10 seconds. Exclusive of retrieval-reproduction interA^als and ad- 
mlnistrative-'time not under sy.stem control that iS used to .^ive general 
instructi-ons and effect housekeeping, arrangements , an S on the average 
would use 15 X '18 seconds,, or 4.5 minutes, to negotiate items of^ any ■ 
ET test and 15 x 6 + 12.x 6 + 10 x 6 seconds, or 3:7 minutes, to negoti-- 
ate items of any PT test. If we allow 3 minutes per test for admin-, 
istrative. matters" and concurrent retrieval-reproduction of programs to 
audio buffer, then each entry, skills test on the average will use 7.5- 
minutes of S's (and so of the system's) tim^; each post-trainiq^ test 
on;^ the average will use 6.7 minutes of S's time. 

Testing 72 Ss on a given entry test on the' average will cost- 12 x 
7.5 minutes, or 1.5 hours, when tests are system-controlled and 6 -Ss 
are tested at a time. Testing 72 Ss' on a given post-training test on 
the average will cost 12 x 6.7 minutes, or 1.4 hours. The total test-ing 
program under these donditions will cost 3 x 1.5 hours + 3 x 1.4 hours,^. 
or 8.7 hours. . • ' 



Assignment to Treatment Groups 

Ss will b« assigned to treatment groups on the basis of performance 
on ET-1. Each item will be scored for correctness of initial (i) , 
medial (m) , and terminal "(t) featui-es or portions of the response. A _ 
response will be scored- R (correct) in the Ko'ehler. study if all portions 
of the response are correct ^d W (incorrect) if none are correct. It 
Mill be scored R1-R3 if two portions~im, it, mt—are correct and RA"^ 
R6 if one portton~l, m, t~is correct.^ . 



^A truljt; automatic-mode system would both monitor and evaluate res- 
ponses and would store-both the. monitored response and its evaluation 
code. A monitored response is one that is apprehended in 'the form giyen- 
the so-called raw datum, 'if S responds "No" to an item, then a monitor- 
whether human' c5r mechanical—is said to have ponitored that response if, 
on demand, the monitor can convey 'that S's response was "No." Latency 
or response time values also " can be monitored. An evaluated response 
is one that is compared with a set of criterion specifications bearing 
on response accuracy, speed, or both. The simplest evaluated response 
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While* Koehler presently can specify the sorts qf "skills profiles" 
that^ will occasion controlled assignment of Ss to treatment groups, he 
will not know until Cycle 1 entry- skills testing is completed just what 
sorts of, skills profiles and proficiency levels the K-level Ss bring 
to such a study. In consequence, he views assignment to treatment 
groups as a task for E, rather than as a task for an appropriately- * 
instructed control and monitoring system. That* is not to say that 
follow-on studies might not ase the system to aid assignment of Ss to 
treatment groups . . 

Whethelr^or not we give the system a role in assigning Ss to treat- 
ment groups"Xio useful purpose would be served by requiring the system 
to teact to Cycle 1 entry skills data in an on-line manner. This is 
because assignment to treatment groups cannot occur until all Ss (N = 72) 
have been tested. If we treait S s time as valuable — which, it is — then 
we will not have him sit around following entry skills testing whi«le 
awaiting assignment to a treatmient group. The obvious implication is 
that entry skills testing^will occur on one day, with training initia- 
ting on a second day. Hence,, assignment to groups can occur during v 
an intervening 18-^21 hour period. The most we could ask of the system 
if it were being u^ed -^to control execution of the Koehler study is that 
it summarize Cycle 1 entry skislls test data — by S, subtest, and code 
or code group — and to output these summaries while operating in an off- ' 
line mode following ET-1 testing of^ithe last S. ] o 



will code the response either as acceptable or unacceptable — right or . - 
wrong. More complex evaluation schemes — e.g. , that for the Koehler 
study — will distinguish between various levels or categories of unaccept- 
ability. The "real time" evaluated, response typically is important in 
experiments only as a time saver; if E can evaluate the rB^onse quickly, 
then he. might wish to record its evaluation code," rather th^ the res- 
ponse itself, thereby accomp^lishing one step in data reduction during 
conduct of the experiment. State of the art controH-monitorlng systems 
do not permit relieving E of this burden. 

In the Koehle^r study, E will monitor S's response and will evaluate 
it when made^ Where partial event control is accomplished by the system— 
as 'will be the case for IDCMS in Version 1 configuration — E will signal 
the evaluation code to the system. While this procedure has small ^impli- 
cati-ons for the data recording c(5des that the system will employ and for 
^characteristics of the terminal through which E will address the system, 
chere-are no conditional implications. That is, required system reaction 
is the same v^ether E signals "Response is completed" or "Response is 
correct." Of passing interest, as executed, the Koehler study will 
bo^h tape responses as made aad record their evaluation codes immediately 
following completidn of the response. The tape record will^ have a fail-, 
safe function; it will be. scrutinized only if anomalies show up in the 
reduced data. 
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Training Treatments 

All of Koehler's training treatments stem from a knowledge-based, 
or phonics, orientation to beginning reading. Two primary training varir 
ables are studied. We denote these emphasis and strategy variables. 
Three cat-ggories of emphasis are distinguished : an analytic or segmenta- 
tion emphasis (S) , a synthetic or blending emphasis (B) , and an analytic- 
synthetic dr combined emphasis (C) . (The mnemonic is SBC). Two cate- 
gories of strategy are discerned: a single-letter strategy wherein 
segmentation Responses go to. the single-letter level' (relatively) and 
blending responses come from that level—denoted l^~and a bipairt strategy 
wherein segitfent^tion responses-^ to a bipartite level and blending res- 
ponses come from, that level—denoted 2_. Where the word is a VC item,- 
the two strategies have iden«:ical implications. Where it is 3-letter 
or 4-letter, tjie single-letter strategy jeally is a tripartite strategy, 
which contrasts wth the bipartite strategy.. Thus, the, study deals (pri- 
marily) with a 3 X 2 matrix of training treatments:- 

■ SI Bl Cl._ ■ . 

S2 ' B2 • g2 

Of passing interest,, the study deals .secondarily with a materials 
factor. Apparently-comparable but different materials— Versions 1 and 
2~will be used. Each primary treatment group will be further subdivided 
into materials subgroups, having ns of 6— denoted Sl.l, SI, 2, . . . , 
C2.2. While it seems improbable that the system could handle a gi^oup 
of 6 Ss where one S belonged to each treatment group, we will ask.it 
routinely to handle a group of 6 Ss half of whom are trained on Materials 
Set A and half on Materials 34t B. 

Four skills— Tl through T4— are addressed during training. Tl 
through T3 skills* are taught to S groups, T3 and T4 to B groups, and Tl 
through T4 to C groups. These skills could be named as follows-: 

Tl - Pronouncing words as units 

T2 - Segmenting words and pronouncing (sounding) the segments 

T3 - Associating the elements of letter-sound rules 

T4 - Combining •and blending t^e sounds of segmented words 

Table A-3 shows treatment groups by treatment ^materj.als sets. 
Noted earlier, eac^ trea^^ient group further subdivides ^nto tyo content 
subgroups for materials. These subgroups receive comparable treatment 
materials but using different words reflecting different letter-sound 
rules . , 
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Table A-3 



Treatment Groups, by Training Materials 

4 



Skill 



Training Materials 



Treatment Groups 



-Jl 
T2 

T3 
T4 



Tl.O 

T2.1 
T2.2 

T3.0. 

T4.1 
T4.2 



SI, S2, CI, C2 

51, CI 

52, C2 

SI," S2,'b1, B2, CI, C2 

/a 

B1,'C1 
B2, C2 , 



• Following sections describe in order the characteristics of each 
training mater ials>s£t , associated training times, and program inven- 
tories^.- But first w^^discuss some conventions. 



Conventions Used to Establish Training Materials Requirements 

1. Content-defined alternative treatment set^ . Two versions of 
each set' of treatment materials—Versions A and B — will be employed 
during every training session*. Thus, if the session features T2 train- 
ing using T2.1 materials. Version A of T2,l will be used for training 

f Ss; Version B, for training 3' others. 

2. Program item orders. The items of every program consisting of 
^wo or more items will occur in two alternative arder.s. Thus there will 
b^ two item-order referenced versions of each such program. Both of 
th^se versions will be employed during^ny session featuring the program 
to w^ich these versions reference. 

3. * Audio programs. The system in present form cannot efficiefit;^ 
compo3e audio programs on-line from smaller elements . To do so require? 
quicker retrieval of audio elements from audio master reproduction than 
the system permits and the sequencing of these elements, whether prior 
to or during reproduction to audio buffer. An alternative is to store 
audio elements outside the system^ to compose minimal nonredundant audio 
programs outside the system, and to load these programs into audio 
master reproduction. Single such programs permit retrieval and repro-,. 
duction to audio buffer with delay on the order of 15 seconds on the 
average. 
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The Koehler study— and most stuMies, involving instruction— features 
-repeated triali for a minimal nonredJh^ant prqgraifi or— in some cases- 
repeated trials for such a program <*oU-&*ed by,.a , switched item order for 
the same program. " Hence, we distinguish between single-trfal programs.-* 
which are nonredundant for content-and double-trial progratas--w^rein 
fche second trial' portion repeats first trial content but withs^itched 
item order. Both types of program' ara taken as unitary entities tor 
purposes of ctordge in audio master reproduction. Transferred to audio 
buffer, the single-trial program that is to be repeated ove^r " trials 
vd.ll require use of a play, rewind, play . etc . . sequence . The double- 
trial program will follow a similar sequence, except that a stop code 
intervening between the program's first and second trial portions will 
permit E to use whatever time he requires, between trials.' For present 
purposes, we assume that ? program of either type in audio buffer will^ 
compel 5. seconds delay between trials. \ . , . 

4. General Instructions (Aq).^ It will be assumed that a general 
instruction Aq will occur at ^he outset 6f an^ training program used 
during any cycle. Were we to t'a^e Ao.; then we would neither.be able to 
take advantage of retrieval-reproduction delay nor be in a position to 
clarify any question that S might have. Hence., we assign the Aq trana 
mission function to E. An example of such an instruction keyed to Tl 
training is (to the effect) '^In this task you are -to look at the word 
on the slide and' listen to how 'it is ^pronounced. Then you are to say 
the word." Maximum retrieval-reproduction delay will not exceed 30 
seconds. That seems a reasonable, t^e limit for ,Aq and Clarification of 
Ao. We assume that E will be able to>prolong iijtertrial intervals for 
purposes of providing adHtional clarifWion if this is required but 
will assume that the 5 second intertrial. d>l.ay value will ref lect the 
average such intertrial clarification requireitteiit (audio buffer rewind 
delay is really less than 5 seconds for the short\programs used in the 
Koehler study). Hence, training time' calculations will reflect a general 
instructions time component that is. 30 seconds plus.5(n - 1) seconds, 
with system switching delay viewed as concurrent to transmission of 
general instructions. (Some programs in addition will tape a very short 
instruction Ai at the front of each item; this event is an integral part 
of item time, rather than of Aq time.) 

5 Housekeeping. Housekeeping consists of moving Ss into and out 

of the "experimental situation and allied procedures not integral, to the 

experiment as such. Housekeeping time will be computed for sessions, 
rather than for the running of programs per se . 

6. Breaks. Break time will be computed/for sessions, rather than 
for running of prdgrams per se. V 

Since the Koehler study is used as the only basis for drawing im- 
plications for IDCMS when educational experiments are to be appreciably 
controlled by the system, one must ask whether these implications are 
s:toply ad hoc. One argument against the ad hoc characterization of the 
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present analysis is that although details of other educational experi- 
ments will differ from those far the Koehler study, other studies will 
stress the syst^em in a comparable manner. Thus, ^or example, while 
intraitem event sequences may be more or less elaborate than those that 
Koehl%r employs, it in^y be t^hat the only consequence is that item pre- 
sentat ion-pTesponse time will increase, or decrease accordiftigly That 
is, intraitem event types and durations reflected in the Koehler study 
should characterize many SURL studies. We know that this will not be 
universally true; for example, intraitem event durations must be much 
shotter in tachistoscopic recognition studies. Thus, while we may reject 
the view that the analysis v^ill be ad hoc in the sense of having only 
the most-narrowly partici^lar implications for IDCMS, we cannot in con- 
sequence accept the view that the analysis has implications of sufficient 
generality to encompass all contemplated educational experimentation at 
SWRL. One way to insure sufficiently general guidance on what IDCMS 
must be able to do is to augment the present guidance through analysis 
of other sorts of training — e.g., in music. Other papers might assess 
coifitrol implications while referencing to other sorts of training. ^ 



Set Tl.,6 MatWials 

Tl instruction will be given to the "48 Ss of Treatment Groups SI, ' 
S2, CI, and C2 . All such instruction will use Tl.O materials. Ss 
will each receive 4 trials — on two items during Cycle 1, four items 
during Cycle 2, and three items during Cycle 3. We assume here that 
intertrial item order need not vary. Hence, the basic program will be 
an Item 1, . . , Item n sequence that, in audio buffer, is presented 
four times in succession in consequence of^ play, rewind, play, etc. , 
operations. Aq time is 30+5(4 - 1), or^45; seconds. 

Although item contents vary from one instructional program to the \ 
next and even from one item to the next, the sequence of events for any/ 
item of any trial of any training program of any cycle of the Koehler / 
study tends to ta\e the same form — although with recursion in the case 
of complex items. The item event sequence referencing to Tl instruction ^ 
is shown in Table A-4. ^ 

The event sequence for a Tl.O item is graphed in Figure A-6 . E / 
first commands retrieval of Tl.O and duplication to audio buffer. Since 
this occurs during Aq time, it need not be reflected in Figure* A-6, 
which describes any one-item sequence for Tl instruction. 

Consonant with foregoing assumptions, four versions of each Tl.O 
program are required — 2 intersubject item orders x 2 content versions. 
The materials requirement is shown in Table A-5. Item and program lengths 
are in normal-play audio tape. 
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Event Sequence for Tl Instruction 



Number 


. Descriptor 


in — 


Event, 


-s 


i - 


Audio Instruction 


A: 


"Repeat (say) the 


word 








after you hear it 


pro- 




> 




nounced (spoken) 


2 


Video + Audio Pre- 


V: 


W 






sentation 


A: 


/w/ 




* 3 


■it '■ ' 

ReHTonse 


Sr: 


Try /W/ 




4 


Audio Ctitfique 


A: 


/w/ 




5 


"Evaluative** Feed- 


Ep: 


E.g. , "Stay with 


it.," 




baick 




'J 
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Although allowed 10 seconds to ;respond, S typically will respond in 
a very few seconds. We assume an. average response time of 5 seconds — 
probably an inflated value. Hence, single-item, single-presentation time 
Is on the ordpr.of 19 seconds (see Figure A-6). iSble A-6 shows instruc- 
tional time implications when the study is under system control and six 
Ss are instructed at a time. 

Table A-6 
Tl.O Instructional Time 



Av. Negot . Av. Negot . No. Groups' Predicted 

Cycle Tr.xlt. Time/Item Aq Time/Prog. "^of 6 Tot. Tl Time 

(sec) (sec) (min) (min) 



1 ' 


8 




19 


45 


3 


.3 


8 


26 


.4 


2 


16 


♦ 


19 


.^^ 


5 


.8 


8 


46 


.4 


3 


12 




19 


45 


h 


6 


8 


36 


.8 



x 



Set T2.1 Materials 

T2 instruction using T2 . 1 materials will be'administered to SI and, 
CI groups. T2.1 slides bear two printed stimuli — a word in normally- 
spaced form at the top of the slide and the same word in segmented form 
at the bottom of the slide — e.g. : 

SAT 
S-A-T 

Two responses are required to the contents of such slides. The 
first is a whole-^word pronunciation response to the top printed stimulus; 
the secon^ an appropriate sounding out of the word, .in segmented form. 
In both instances', S'« response, simply repeats" an audio mocielling of the 
response. To guide S concerning which printed stimulus is associated 
Ad-th the audio accompanyment that S is to repeat, the stimulus is boxed . 
Boxing of successive stimuli ne^^essitates^ us^g two slides per item, 
rather thsin one. These two slides differ only in that the first boxes 
the top stimulus — e.g., SAT — while the second boxes the bottjor ^ " bl i^nulus — 
e.g., S-A-T. 
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The T2,l itzem is a two-response item — as distinguished from the 
one-response itetns of Tl instruction and items to which we will come 
directly, which ran-ge up to six-response Value. The Koehler study con- 
trols both for total training time per cycle per treatment group and 
for total number of presentation-response (or critiqued instructional 
response) entjjiies. Hence, number of responses per item is relevant both 
to quantification of the materials requirement and of instructional time. 

Event sequences for a presentation-response entity of T2 training 
using T2.1 materials hav§ the same form as those for Tl training. The 
following sequence, which applies to the second, or segmented, stimulus 
of a Cycle 1 item, is illustrative. 

A: ''Repeat the (audio stimulus) after you hear it spoken." 



V: C-V-C 

A: /C/+/V/+/C/ 

Sr: Try /C/+/V/+/C/ ^ 

A: /C/+/V/+/C/ . 

Ep: E.g., "Simply amazing." 

Timing of the^event sequence should follow that for Tl.O items 
except that: a), per item costs will double for the two-response items 
of T2.1 and b) audio rendition of /C/+/V/+/C/ should cost two seconds 
rather than one. Hence, tape cost of the two-response item will be 30 
seconds. The materials requirement is shown in Table A-7. 

Consonant with greater complexity of the segmentation response, we ' 
assume T2.1 responses will average 6 seconds. Figure A-6 and foregoing 
comments support the view that average item negotiation time will be 
2 X 22, or 44, seconds. Table A-8 shows instructional time implications 
when the study is under system control and six Ss.are instructed at a 
time. Aq computations are based on the 30 + 5(n - 1) seconds formula. 



Set T2.2 Materials 

T2 instruction using T2.2 materials will be administered to S2 and 
C2 groups. Materials differ from T2.1 materials primarily in how words 
are segmented, which is bipartitely, in number of stimuli per sli'de, and 
in item complexity. Tgble A-9 shows the pertinent data. 

Consonant with conventions established above, tape cost will be 15 
seconds per- response — or 30 seconds per item for 2-response items and 
45 seconds per item for 3-^sponse items. The materials requirement is 
shown in Table A-10. 
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Table A-8 
T2.1 Instructional Time 



Cycle 


V' 


TxIxR 


Av. Negot. 
Time/R 
' (sec) 


(sec) 


Av. Negot. 
Time/Prog, 
(min) 


No. Gr. 
o*f 6 


Predicted 
Tot T2.1 Time 
(min) • 


1 


SI 


48 


22 " 


85 


19.0 


2 


38 ;o 




CI 


24 


22. 


53 


9.7 


2 


19.4 


2 


SI 


96 


; . ■ § 

- 22 


• 85 


36.6 


2 


73.2 




CI 


48 


■ .22 


55 


18.5 


2 


37.0" 


3 


SI 


48 


22 


65 


18.7 


2 


37.4 




CI 


24 


22 


45 


9.1 


2 


18.2 
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Table A-9 

Programs, Response Levels, and Illustrative Items 
for T2 Training Using T2.2 Materials 



Cycle 



Program 



No. Rs 



Illustration 



1.1 



SAT 
S~AT 
A-T 



1.2 



SAT 
S-AT 



2.1 



SIN 
S--IN ' 



2,2 



2,3 



SPIN 
SP-IN 
I-N 

SPf^ 
SP~IN 



3.1 



INK 
I-NK 



3.2 



' LINK 
L-INK 



3,3 



LINK 
L-INK 
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' Ag^in We assume an average negotiation 'time per response of 22 
seconds. Table A-11 shows irtstrudtional time implications when the 
study is uYide^i^ system control and six Ss are instructe<^ a time. 

Set T3.0 Matet\ials 



All 72 Ss\receive T3 training using T3.0 materials. All^'Ss receive 
this training i\n the same amount. The same 6 letter-sound combirfations 
are taught durihg Cycles 1 and 2, with 2 additional letter-sound- combin- 
ations added to\the set during Cycle 3 training. During Cycles 1 and 
2, the set' af 6 trules is split into subsets of 3 rules each for pre- 
liminary traininlg purposes. S first receives 2 trials on each rule of 
the first subset^ but with randomization across trials. Next he receives 
2 trials on each ^ule of the second subset under- the same procedure. 
Finally, he receives 4 trials on each rule for the set as a whole. The 
same procedure is\ followed in Cycfe 3 excep± that set size is 8 and' sub- 
set size is A . i Again, two materials sets are used. Table A-12 illus- 
trates the mater iails requirement for one materials se*t. Here.it is 
important that a degree of trial- to-trial randomization of iteips occur.. 
Half of the add-nuAbered Ss might receive the odd-numb^red programs of 
Table 4; half of the even-numbered S s , the even-numbered programs. The 
remaining Ss would receive comparable programs from a second materials 
set. (Of passing interest, these mater ials-. lend themselves well to on- 
line composition of Irandomized sequences. However, if the system has 
no such capability, \then one must preform the sequences and store thes6 
in audio master reproduction as required.) The last column of Table 
A-12 illustrate^ the 1 rewind-replay operation for a program stored in 
audio "buffer. That ils^ v^en four trials must occur, one rewinds the two- 
trial program and repeats the program. Stop codes should intervene 
between the single- trjLal components of these programs. 

The same sequence of ' events referencing to presentation of a given, 
letter-sound combinatllon characterizes T3 training as characterized 
presentation of a given item or part-item during Tl and T2 training. 
Again video-audio presentation is followed by S's attempt to repeat 
audio. This in turn is followed by a critiquing representation of audio 
and evalis^ative feedback from E. Perhaps the only difference* is that 
average response time spould be shorter — let us say 3 seconds — and eval- 
uative feedback shorterlalso — let us say 5 seconds. It also appears 
tenable that the audio instruction fronting each it'em should dro^p out.' 
In consequence, audio tape per it^ should be on the order of 7.5 seconds. 
Allowing 5 seconds of tape for sfrop Intervals, programs of the A1-A4 
type will be 50 seconds llong; those of the <»B1-B4 type, 65 seconds; those 
of the A5-A6 type, 95 seconds; those of the B5-B6 type, 125 seconds. 
Th^<s^terials requirement: is shown in Table A-13. 1, 

Con^t^nt with foregoing remarks, presenta^ion^response time per 
item should t>e on the order of 15 seconds. Table A-14 shows instructional 
time implicat iob^when th|e study is under system control and six Ss are 
instructed at a tin 
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Table A- 12 

Two-Tri^l T3.0 Programs Featuring Intertrial Switching of Item Order 



Cycle 


Program^ 


^ , Trials 1-2 


Trials 3-4 


"1-2 


Al- 
A2 

A3 
A4 


SPA-PAS 
APS-PSA 

NTI-TIN 
ITN-TNI 






A5 
A6 


SANTIP-TNAPSI 
APNITS-PASTJN 


Repeat A5 
Repeat A6 


3 


Bl . 
. B2 

B3 

B4 ' 


KSAP-SKPA 
AKPS-PASK 

NLIT-LNTI 
TILN-ILTN 




f 


B5 
B6 


LSATKNIP-KSLINTPA 
STNFLAKI-PNLKATIS 


Repeat B5 
Repeat B6. 



^All of these programs belong to one content version. The other 
version uses different consonant letter-sound rules., Those who receive' 
the Table A-12 l^ersion receive only half of the tabled programs — the 
odd-numbered ones or; the even-numbered ones. These programs .differ 
from previous ones in being of two-trial length, to accommodate a require 
ment for intertrial switching of item order wi4:hout incurring the usual 
retrieval-reproduction dela^ between trials^ 
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Set T4.1 Materials 

T4 instruction using T4 . 1- materials is given to Groups Bl and CI. 
Table A-15 shows the forms of items across cycles. 

Table A-15 

Illustrative T4 , 1 Items 



Cycle Illustrative Item 



1 / ' P-A-N 

PAN 

2 ' SP-rA-N 

SPAN 

"^3 . S-A-NK 

' SANK 



The basic event sequen-ce is as indicated for earliet instructi^on . 
Setting tape per response at 15 ^seconds , then the .two-response items of 
TA training 'using T4,l materials use 30 seconds of tape. The materials" 
requirement is shown in Table A-16 . " . 

'\ 

Assuming as earlier an average negotiation time per response of 22 
seconds, Table A-17 shows instructional time implications when the study 
is under system control and six Ss are instructed at a time. 

Set T4.2 Materials 

T4 instruction using T4,2 materials' is given to Groups B2 and C2 . 
Although segirtentation is bipartite rather than tripartite, materials are 
more extensive *than far-draining using T4.1 materialsv - T'he-inat^rials 
for one content version of T4.2 programs is shown in Table A-18 . 

A-T4.2 program of the Program 1.1 , type requires S to respond 4 times 
to each of 2 items. Itelhs range from 2-response (e.g.. Program 1.2) to 
6-response (Program 2.2). The T4 . 2 materials requirement, is shown in 
Table A-19 • Again we assume 15 seconds of tape per response. 

Assuming again an average negotiation time pe^: response of 22 sec- 
onds. Table A-20' shows instructional time implications wh>en the study * 
is under system control and six Ss are instructed at a time. 
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Table. A-18 
T4.2 Materials for One Content Versicn 



Cycle 




Program 


I terns 


fqr Dne 


Content 


•J 

Version 








(1) 




\ / 




1 


• 


1. 1 
















AN 


IT* 












P-AN 


S- IT 




o 








PAM 


*S { T 
»i 1 I 










1.2 


P-AN 


S-IT 












P A M 


M 1 




















■> 




2.1 


A-N 


I -P 












AN 


IP 












SP-AN 








• \ - 




\ 


SPAN 


TIP 










2.2 


. A-P 














AP 






• 








N-AP 














NAP 






F 
















* 






SN-AP 




















cr 






2.3 ij 


/ SP-AN 


T-IP" 


N-AP 


SN-AP 








SPAN 


TIP 


NAP 


SNAP 


3 




3.1 


A-NK 


I-NT 












ANK 


TNT 






n 






S-ANK 


T-INT 












SANK 


^'INT 










3.2 ^ ii 


S-ANK 


. T-INT 












SANK 


* TINT 





















Single items read dav/ri. Responses, per item range from 2 to 6. 
The content version employs 14 unique printed stimulus laj^outs. Since 
these must appear with one or the other of the two printed' stimuli box^d , 
the content version implies 28 video ftames. Two content- ^^aions would 
require 56 video frames if the second version showed the same"l')verlapping 
pattern across programs as does 'the first. * . 
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Magnitude of Training / 

Table A-21 shows total number of training responses and total trail 
ing time, by treatment group and cycle. Response values coincide with 
those of the Koehler formulation.^ Training time values are those gen- 
erated above. While the study in manual mode execution might not allot 
the values reached. above for presentation-respon&e sequences, study 
scheduling suggests that overall training time values ^re approximately 
those reached in Table A-21 and Table A-22'. The study allocates six 
sessions to the training of any S. If each session uses 20-24 minutes 
for actual training, then study training time will correspond to that 
shown in Table "a-22, which s^vflnmarizes training across skills and cycles 
Excepting for slightly longer S2 and C2 Cycle 2 and Cycle 3 training 
times, the tables shoW marked intracycle matches fimr training time 
across treatment groups . 



168 



-170- 



Table ^-21 

Response and Training Time Totals, by Treatment Group ^and ' Cycle 



Or. Materials 



Cvcle 1 



Prog. Rs 



Tng. 
Time 
(min) 



Cycle 2 
Prog. Rs 



Tng. 

Time 
(min) 



Cycle 3 



Prog. 



Rs 



Tng. 

Time 
(min) 





i 1 . u 


1 . 1 


p 

o 


J 




9 


1 


1 A 
1 D 




5 


Q 

. o 


J . 1 


1 9 


^ . 


0 




TO 1 
1 J . 1 


1 . 1 




1 Q 


. u 


9 


. 1 


Q A 


3 


6 


O 


1 1 
J . 1 




lo , 


7 
/ 




T3.0 


i.i 


6 


2 


1 


1 


1 


6 




2 


1 


2.1 


8 


2 


6 






1 • 4. 


(i 
D 








9 


D 




2. 


1 
1 


9 9 


Q 
O 


9 


■ n 






1.3 


24 


6 


.8 


1 


3 


24 




6 


.8 


2.3 


32 


8. 


8 




Totals 




92 


33 


3 






148 




3. 


4 




108 


37. 


3 


ai 


T3.0 


" 1.1 


6 




.1 


1 


1 






2 


.1 


2.1 


8 


2 


6 






1.2 


6 


■ 2 


.1 


1 


2 






2 


1 


2.2 




2 


6 






1.3 


24 


6 


.8 


1 


3 


24 




6 


.8 


2K3 




8 


8 




T4.1 ■ 


1.1 


56 


22 


1 


2 


1 


112 


42 


.7 


3.1 


60 


23 


7 




Totals 




92 


33 


1 






148 


53 


7 




108 


37 


1 


Cl 


Tl.O 


1.1 


8 


3 


3 


2 


.1 


16 




5 


.8 


3.1 


12 


4 


6 




T2.1 


1.1 


24 


9 


.7 


2 


1 


48 


18 


.5 


3.1 


.24 


9 


.1 




T3.0 


1.1 


6 


2 


.1 


1 


.1 


6 




2 


.1 


2.1 


8 


2 


.6 






1.2 


6 


2 


.1 


1 


2 


6 




2 


1 


2.2 


8 


2 


.6 






1.3 


24 


6 


.8 


1 


3 


24 




6 


.8 


2.3 


32 


8 


8 




T4.1 


1.1 


, 24 


9 


.7 


2 


.1 


48 


18 


5 


3.1 


24 


^ 9 


.7 




Totals 




92 


33 


.7 






148 


53 


.8 




108 


37 


4 



S2 



Tl.O 


1.1 


8 


3 


3 


2.1- 


16 


5.8 


3 


.1 


12 




6 


T2 .2 


1.1 


24 


9 


.6 


2.1 


44 


17:5 


3. 


1 


28 


11 


3 




1.2 


24 


9 


.7 


2.2 


3d 


11.8 


3 


.2 




5 


.2 












2.3 


. 24 


9.7 


3 


3 


t 


. 3 


7 


T3.0 


1.1 


6 


2 


.1 


1.1 


6 


2.1 


2 


.1 


8 


2 


6 




1.2 


6 


2 


1 


r. 2 


6 


2.1 


2 


.2 


8 . 


2 


6 




1.3 


24 


6 


.8 


1.3 


24 


6 .8 


2 


3 


32 


8 


8 


Totals 




92 


33 


.6 




150 


55.8 






108 


38 


8 
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Table A-21 - conCinued 









Cycle 


1 






Cycle 


2 




Cycl^' 3 


Tng. 


Gr 


Materials 








Tnfe. ° 








Tng 






Rs 




Pros. 


Rs 


Time 


Prog. 


Rs 


Time 


Prog. 


Time 












(min) 






^ 


(min) 




\ 


(min) 


B2 


T3.0 


1. 


1 


6 


2. 


1 


1. 




6 


2. 


1 


2.1 


8 


, 2.6 




1. 


2 


6 


2. 


1 


1. 


i 


. 6, 


2. 


1 


2 . z 


Q 
O 


2.6 






1. 


3 


2A 


6. 


8 


1. 




24 


6 . 


8 


2 . 3 


32 


8.8 




TA.2 


1. 


1 


32 


12. 


5 


i: 


1 V 


. 32 


12. 


5 


3 . J 


32 


12.5 




1. 


2 


2A 


9 . 


7 


2. 


2 


30 


11.8 


3.2 




11.3 
















2 . 


3 


48 


18. 


5 










Totals 






92 


33. 


2 






146 


53. 


8 




108 


37 .8 


C2 


Tl .0 


1 


. 1 


8 


3 


.3 


2 


1 ■ 


16 


5 


8 


3.1 


12 


4.6 


T2 .2 


1 


. 1 


12- 


5 


.0 


2 


.1 


20 


8. 


2 


. 3.1 


12 


5.1 






1 


.2 


12 


5 


.1 


2 


2 


12 


5 


0 


3.2 


6 


2.8 
















2 


.3 • 


12 


5 


.1 


3.3 


4 


2.1 




T3.?l 


1 


.1 


6 


2 


.1 


1 




6 


2 


.1 


. 2.1 


8 


2.6 




y 


1 


". 2- 


6 


' 2 


.1 . 
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.2 


6 


2 


.1 


2.2 


8 


2.6 
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.3 
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1 
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2.3 


32 
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6 .5 
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5.1 
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9 


.5 
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.4 
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.1 




110 


40.2' 
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'ABSTRACTS OF RELAIED" DOCUMENTS.: 1971-72 



NATURAL^ LANGUAGE ANALYSIS 

* 

TM 5-71-02. Ann, Porch. An Analysis of Methods for Preparing a Large Natural 
Language Data Base , February 16, 1971. 

^ Relative cost and effectiveness of techniques for preparing a computer- 
compatible data base consisting of approximately one million words of 
natural language are outlined. Considered are dollar cost, ease of _ 
t^diting, and timjB consumption. Facility for insertibn of^J^iietrcTTying 
information within the text, and updating of a text by tnerging with 
another text ar-e given special attention. It is concluded that MTST ^ 
and Telterm2 are two highly ef feet ive- methods of text preparation. 
The decision of which to use on a particular project would depend on 
available funds and po^ible peripheral uses for the equipment. Criteria 
for' making such a decision are- discussed. 

TN 5-71-39. Lanaii Kline. QUES (Question Survey) , June 11, 1971. 

QUES is a computer program which answers pred^Skrmined questions about 
an information bank of an IMS reading program; ^There .are eight questions, 
each represented by a subroutine to the main program. Part of the 
variable input controls the program flow, i.e., controls which questions 
are to be q.ueried and the number of times, vai^iab le input will be pro- ' 
vided for each question. Thus, the user can specify that question //I 
be queried with two sets of variable input, question H be queried with 
one set of variable input, etc. 

TN 2-71-10. Carol Pfaff. Naturalistic Observational Dialect Sjajdies : 
Processing and Output, Format Requirements , July 21, 1971. 

" ^ This paper is part of a series c^gj^umenting data processing requirement^ 

for naturalistic observational dialect studies. Companion ^documents 
are Russell (1970) and Legum and Pfaff (1971). This paper describes 
major processing routines involved in the_f orrrt^tion of KWICs , CODE 
TABLES, and FREQUENCY LISTS, and specifies the desired output format 
for e^ch. Aspects df 'input format which are relevant to programming - 
'these processing types are also specified, 

TN-2-71-11. Stanley E. L^gum and Carol Pfaff, Naturalistic Observational 

Dialect Studies: Addit:4onal Requirements and Usage Estimates , July 29, 
1971. 

Part I of this paper describes automated "housekeeping'* requirements 
associated with large scale naturalistic observational dialect studies. 
Part II describes the special requirements necessitated by unequal 
sample sizes. Part III estimates the relative frequency of usage of 
each of the major routines which are required as a function of the 
number of groups and speakers studied. Russell (1970) and Pfaff . (19^71) 
are require<i reading to place this document in perspective. 
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5-71-10, Ann Porch. ^ People and Projects in Natural Language Processing : 



Preliminary Bibliographic Directory , 



Aygust 5, 1971. 



This dp-cument is part of a continuing si^vev of the field of natural 
language processing. It presents an overview of applications in 
education, literature, computational linguistics, information 
■ retrieval, machine translation, and art[ifieial intelligence. Primary 

consideration is given to researchers working or publishing in tlfe 
^ United States since 1960, with the bulk of the citations confined to 
the past three years. Addresses and pHone nlimbers are supplied where 
such information is available. Source materials are largely secondary, 
with most references derived from specialized periodical bibliogra- 
phies in the field. The directory is prepared in bomputer-compauib le 
form for ease of updating. 

5-71-91. Ann Porch. Comparative Code Chart (Interim Version) , August 10, 
- L971. . 

A chart is given which allows the user to make rapid and easy com- 
parisons among the following commonly used computer-oriented forms of 
coding date: binary, octal, decimal, hexidecimal, ASCII, BCD, EBCDK, 
paper tapfe, punch cards (026 and'G29). A^riief discussion is given of 
the manner in which the chart is intended to be.ut>ilized and of con- 
ventions used' in its compilation. 

5-71-56. Lanaii Kline. E ssay Word Count and Statistics P rogram, August 18, 
1971. ' ' . ' 

This program searches an essay fc5r unique words and maintains' a fre- • 
quency coimt for. each unique word. Three reports are prepared: 

(1) a frequency ordered Hat ' * 

(2) an alphabetized word list ^ 

(3) a word/sentence statistical breakdown 

This program is an expanded version of the ^SSAY WORD COUNT PROGRAM 
(TN 5-70-12). 

5-71-74. Ann Porch. Preliminary Design for a Language Analysis Package 
(L,A.P.) , August 18, 1971. ^ 

A package of computer programs to handle natural language; ret rieyal 
analysis in a manner analogous to that of a statistical package is 
discussed. The document presents an overview of several, language 
analysis projects currently underway, and of several research approaches 
to resolving problems in language analysis. ''Emphasis is presented on the 
way the L.A.P. could be used with each approach. Design specification 
for a package sensitive to the state-of-the-art are dbcumented. A 
preliminary implementation, using programs in SWRL*s possession, is 
suggested as a first step in the development process . An overview of 
the design considerations and algorithms for the preliminary package is 
presented. . " . 
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TN 5-72-01. Lanaii Kline. Story-List , January 21, 1972. 

This document describes the program, STORY-LIST which prepares an 
' alphabetized cumulative vocabulary list for each story within a school 
grade. ^ 

TN 5-72-10. Lanaii Kline. CONC-Dictionary , February 29, 1972. 

The program sets u^p three dictionaries; basic, fiction, and fantasy 
words. It then processes each essay by parsing the essay into words, 
checking if the word is a legal word (in the dictionary), and adding 
it to the essay unique-word list. 

X^J 5-72-27. Ann Porch. Modulei Design Document: Scan Module - L.A.P. 
Version I , April 24, 1972. ~~' 

This is one of a series of technical design specifications for individ- 
ual modules in the Language Analysis Package *(L. A.P. ) . 

The Scan Module will read input text, divide it into words, and check 
for special characters indicating further action needed. 

PERIPHERAL SYSTEMS 

Data Entry 

TN 5-71-^2^. Ann Poroh. A Hardware Configuration for a Flexible, Multi- 
purpose Data Entry Station , May 13, 1971. ' - 

The SWRL Computer Center recently acquired hardware for a data-entry 
station of high -flexibility and wide-spraad applicability. "^le system 
employs a Cathode Ray Tube (CRT) video terminal ,y/ith keyboard combined 
with two incremental cassette recorders, a standard teletypewriter, a 
modem for computer communication, and a Switching connection box -for 
controlling the flow of data. It can be used either for entering data 
on-line to a computer, ox off-line as an editing station for preparing ^ 
computer compatible materials. 

This dbcument is Intended to serve as a system description: and an 
operating manual. It does, not attempt to replace the iftanuals associated 
with the individual components of the data entry station, but rather to 
coordinate and condense the information c<5ntained within them into a 
single presentation of the system as a whole. The presentation is 
divided into two major parts: (1) a description of- the system; (2) a 
manual for operations. » * . 

TN 5-71-86. Ashok Dave^ Analysis of Presently Available Optical Mark 
Readers , August 18, 1971. 

This dbcument analyzes presently available Optical Mark Readers on 
the basis of evaluation factors discussed «i,n TN 5-71-90. 
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TN 5-71-90. Ashok Dave'l Factors} Re levan^^I;o the -^valuation of IMS-Data- 
Input-Compatible Optical Marik Readers /At^aA^st 18, 1971. ^ 

Several types of optical readers using variousx^hniques, and having 
" wide applications are preserjt-ly available on th^e^rHa^kgt . An attempt 
has been made to es]\ablis'h>.c ' ' • - • ^ ^^'^^^^^ . 

in selecting compatib^ equi 

TM 5-71-11: Ashok Dave'', Conside 



Machine Interaction , November 3, 1971 



riteria and information whi^ch will assist 
pment that is cost-ef fect/ve with IMS, 

rations in Selecting ^Ke/boards for Man- 



-Factors discussed include keyboard layout character set, accessibility, V 
key characteristics, and corltrol/ function keys , © 



Remote Joh Entry I 

" i ■■ 

TN 5-71-42V Sheridan Bentson, User's Guide for Remote ^oh Entry to Jet 
^ Propulsion Laboratory, June; 28, 1971, ■ ~ 

The Remote Job Entr^' (Interjim yersion) into Jet Propulsion Laboratory's 
UNIVAC 1108 Computer is operating on SWRL' sj^mmand 690 'System, This ' 
dopument explains the use and restrictions" of the RJE as it presently 
exists. . 

TN 5-^71-43, Sheridan Bentson. Status Report on 690/1108 Remote Job Entry 
Computer Software (Interim Version) , June 28, 1971, ^ 



The Interim Version of the Remote Job Entry to Jet Propulsion Laboratory's 
UNIVAC 1108 Computer is operational on SWRL' s Command 690^ System, This 
report is a Programmer's Guide to the present* RJE system ,^ indicating ^. 
the status of the present computer software, 

^ ) ^ ' 

TN 5-71^79, Sheridan Bentson. Calculating Theoretic a jg Transmission Speeds 
of a feemote Job Entry , August 6, 1971, ^ 

An kipper bound on the data' [trans fer rate in a computer remote job entry 
system can be calculated by considering transmission in an error-free 
environment. This Technical Note presents a function for making such 
a computation, ^ 

TN 5-72-06, Sheridan Bentson, ^ Programmer's 'Guide to the Remote Job Service 
to UCLA, January 31, 1972. 

This report contains a technical description of the 690 software 'system 
'RJS', which offers renjote* job ent-ry terminal service from SWRL's 690 
to UCLA's IBM 360/91, 

TM 5-72-07. Sheridan Bentson, Terminal Job" Entry , July 6, 1972. 

SWRL' s Terminal Job Entry (TJTE) is a computer software system for the 
Command 690, TJE allows medium-speed operation of a timesharing Central 
Computer, using the Command 690' s peripheral devices. 
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STUDENT-SYSTEM INTERAGTION 



TN 5-71-23. Milton Schwartz. Display Terminal Oriented Software J^OS) . 
Interim User's Manual , April 27, 1971. ^ / " / 

DTOS is a generalized library subroutine package designed to facilitate 
Telterm II CRT display manipulation from'a computer. The roiJi,tines 
are written in^EXFOR (International Timesharing Cojiporatton* s Extended 
, Fortran IV). EXFOR contains many a^^anced featur^ not available in 
standard Fprtran IV. ' 



TN 



5-71-30. Milton Schwartz. Hardware Specifications and Operation of the . 
Random Access Audio Device , May 19, 1971. 

This TN reports on the hardware aspects of the Random Access Audio 
Device (RAAD) being evaluated for use as a component in an experimental 
Instructional Learning Station under development at the SWRL Computer 
' Center. The RAAD has been interfaced with a teletype terminal which 
* operates ^on a dial-up mode to a remo^te time-shared computer The 

computer has been programmed to selectively call out prestored audio 
'messages from the RAAD - to ef fectively' simulate a learning situation 
and present reports' on learning performance. 

TN 5-71-41. A^hok Dave^ and Frank Teplltzky. Exploratory Work With the 
. Brobeck and Associates Random^Access Audio Device , June 23, 1971. ' 

This document describes the functional aspects of the Brobeck and 
Associates Random-Access Audio Device, the coiriputer spftware re'^quirements. 
to access it, and the scripts prepared in connection with developmental 
tests of the hardware/software functions. 
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5-7i-45. Ashok Dave^ and Fxank Teplitzky., Overview of Audio Response 
Systems , July 16, 1971. 

This document presents an overview of ^computer-controllable audio 
response systems based on information extracted from vendor supplied 
brochures and recent literature. 

5^71-75. Ashok Dave'' and Milton Schwartz, Overview of Visual Display , 
Systems, August -18, 1971. 

An overview of computer-contrdll.able visual display systems based on 
information extracted from vendor supplied brochures and recent literature 

5-71-88. Ashok'Dave^ Cost-St orage Capacity Analysis of Mini-^ Computer 
Compatible Magnetic Disks , August 18, 1971, 

This document describes the characteristics of varieus kinds of magnetic 
^ disk storage devices, and presents a 'cost -^^-fe^age^ capacity analysis of 
mini-computer compatible disks. 
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TN 1-72-01. Joseph F. Follettie. Experimental and Student-System Interactive 
Instructional Illustrations Pertinent to IDCMS > February 1972. . ' 

SWRL IDCMS will be a flexible hardware system for controlling . and 

nitoring instruction and research' in the Laboratory setting. . This 
pap^r seeks to introduce potential ushers to the system and software 
designers to representative challenges that system ex|)loitation will* 
pose. - 
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